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APPELLANT'S BRIEF 


Appellant/ Rolf Jansen, pro se, very respectfully appeals to 
the Board of Appeals and Interferences from the Final Office 
Action/ rejecting appellant's claims/ and will show the Board 
the following: 

I 

Summary of Invention 

The two claims of the appellant concisely summarize the 
invention : 

An assembly of a camcorder-type liquid crystal display 
monitor/ comprising means for mounting said assembly to 
the inner retracted side of a driver's sunvisor of a motor 
vehicle / 

whereby said sunvisor/ when lowered/ allows a driver easy/ 
direct/ close-range/ sunlight-protected viewing of said 
monitor screen/ as if the screen were a rear-view mirror, 
when used in conjunction with a video camera, to see to 
the rear when the unaided view is obstructed- 


An assembly of a micro-video/ pin-holed lens camera/ 
comprising means for mounting said assembly on the reverse 
side of a plate/ such as a license plate/ at the rear of 
a trailer or motor vehicle/ so that said camera can see 
through a predetermined-sized hole put in said plate/ 
whereby said plate-mounted assembly conceals said pin-holed 
lens camera to lessen the risk of vandalism/ 

whereby said camera is located in the ideal position at the 


rear of a trailer or motor vehicle for viewing a backing/ 
when used in conjunction with a monitor. 

II 
Issues 

Appellant contests the examiner's conclusions for rejection 
of appellant's two claims. Said conclusions are stated below: 

"Claim 3 is rejected under 35 U.S.C. 103(a) as being 
unpatentable over King (US 5/971/468) in view of Frankhouse/ 
et al. (US 5,040/120).... Taking the teaching of King and 
Frankhouse together as a whole/ it would have been obvious to 
one of ordinary skill in the art to modify the camera (96) of 
Frankhouse into the system of King for the same purpose of 
capturing a angle rear view of traffic or objects behind the 
vehicle . Doing would allow the driver see a various locations 
around the vehicle without turning his/her head around." 

"Claim 4 is rejected under 35 U.S.C. 103(a) as being 
unpatentable over Abersfelder et al (US 5/646/614).... Taking 
the teachings of Abersfelder et al and Aviv together as a 
whole/ it would have been obvious to one of ordinary skill in 
the art to modify the pin hole lens of Aviv into the system 
of Abersfelder for the same purpose of seeing through the 
predetermined sized hole of license plate." 

Ill 

Grouping of Claims 

Appellant contends that his two claims do not stand or fall 
together/ and appellant later in this brief will explain in his 
arguments why the claims of the group are separately patentable 


\ 
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IV 

Arguments 

It is important to put two quotes of the examiner/ from his 
Final Detailed Action/ next to each other. A copy of the Final 
Detailed Action is attached as Exhibit 1. 

Quoting from page 2, line 10 under heading Claim Rejections - 
"Re claim 3/ King discloses an assembly of a camcorder-type 
liquid crystal display monitor (26 of Fig.l) is mounted to the 
inner retracted side of a driver sunvisor (24 of fig.l) of a 
vehicle (20 of fig.l) when the sunvisor is lowered allows a 
driver easily direct/ close-range/ sunlight-protected viewing 
of the monitor screen/ the display monitor is connected to a 
navigation system to display a navigation information." 

Quoting from page 2/ line 1 under heading Response to 
Arguments: 

"Applicant's arguments with respect to claims 3 and 4 have 
been considered but are moot in view of the new ground(s) of 
rejection." (Emphasis added.) 

The inference that appellant draws from these two statements 
is that the examiner determined that King and appellant's 
invention are the same. Such inference is necessary to compre- 
hend why the examiner said all of applicant's arguments were 
moot / when applicant's first argument was that King was 
inoperable as prior art because applicant's filing date of his 
provisional patent application came before the filing date listed 
for King. 

Below/ the appellant will show that the examiner erred in 
making the determination that King and appellant's invention 
are the same: 

A. Examiner erred in stating that the display in King was 
"a camcorder-type liquid crystal display monitor." 

It is common knowledge that a camcorder-type LCD monitor 
shows motion pictures. In order to determine what the display 
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of King shows/ appellant attaches as Exhibit 2, a copy of 

King and quotes from the section covering the background of the 

invention/ on page 3/ starting at line 1: 

"This invention relates to a combined vehicle sunvisor and 
display panel. 

"Vehicles are being supplied with more and more displays to 
provide information to an operator. As an example/ information 
with regard to the current operating condition of the vehicle/ 
such as speedometer/ fuel gauge/ oil temperature/ etc. have 
historically been provided to a vehicle operator. More recently/ 
new products such as vehicle navigation systems have provided 
additional information to the operator. 

The increase in the amount of information provided to the 
operator has resulted in a situation wherein there are many 
display areas on the instrument panel of the vehicle. Many of 
these areas are in a location wherein the driver must look away 
to access the information/ such that the driver's attention is 
not on the road." 

In summary, the display in King shows numbers, letters/ 
symbols to replicate data that appears on the dashboard. 

Appellant will show that a camcorder-type liquid crystal 
display monitor is a special type of LCD that evolved from the 
electronic viewfinder of a video camera/ and that it is struc- 
turally different from the display of King. 

Appellant will show that the term "camcorder-type liquid 
crystal display monitor" in appellant's claim 3 differentiates 
appellant's invention from King. 

Quoting from the scientific book/ Newnes Television and Video 
Engineer's Pocket Book / Third Edition, by Eugene Trundle/ 
Newnes Publishing/ Oxford/ 1999 (pages of which are attached as 
Exhibit 3)/ on page 148, starting at line 1/ under the heading 
Viewfinder : 


"The camera's electronic viewfinder (EVF) has three main 
functions .... and it acts as picture monitor during in-the- 
field playback in the case of a camcorder...." 

Quoting again at lines 26-28/ at the bottom of page 148: 

"Although physically very small/ the components and tech- 
niques of the EVF are just the same as are used in the TV 
receiver and monitors covered in the first half of this book." 

Quoting again/ at the top of page 149/ starting at line 1: 

"The fact that colour viewfinders struggle to do justice 
to the performance of a good video camera has not prevented 
manufacturers incorporating them in home-movie camcorders! A 
few models offer the best of both worlds/ with a conventional 
black-and-white VP tube plus a small (4-10 cm diagonal) colour 
LCD display in a fold out panel on one side of the camcorder 
body. " 

Quoting at page 9, titled Chapter 2, TV and Video Waveform 
and Standards/ lines 7-10: 

"For moving pictures it is necessary to present a series of 
frames at a rate which will fool the human eye into believing 
that it perceives continuous movement; and which avoids 
noticeable flicker. " 

Quoting at page 10/ lines 12-14: 

"Taking the European 625/50 standard as an example / then, 
the requirement is for the picture to * light up* 50 times per 
second to avoid a bad flicker effect." (Emphasis added.) 

Quoting from the scientific book, Practical Electronics for 
Inventors / by Paul Scherz, McGraw-Hill Publishing/ New York/ 
2000/ (pages of which are attached as Exhibit 4)/ at page 515/ 
lines 1-3: 

"A number of displays can be interfaced with control logic 
to display numbers/ letters, special characters/ and even 
graphics. Two popular displays that we'll consider here 
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include the light-emitting diode (LED) display and the 
liquid-crystal display (LCD)..." ( No mention of showing movies .) 

Quoting at page 521, lines 10-11, and continuing at page 522, 
line 1: 

"One disadvantage with LCD's is their slow switching speeds 
(time it takes for a new digit/character to appear) Typical 
switching speeds for LCD's range from 40 to 100 ms . " 

The abbreviation for millisecond is ms . One millisecond is 
1000th of a second. 40 ms equals l/25th of a second, which, is 
the fastest speed that a typical LCD display can change to a new 
digit/character. 

The camcorder-type LCD monitor, although very small, uses the 
components and techniques of a TV receiver. It shows a picture 
of the content of the whole screen at least 50 times a second, 
or once in l/50th of a second. 

Showing motion pictures on the display of King would distract 
the driver from looking at the road. The display of King does 
not show motion pictures, and it cannot show motion pictures 
because its internal structure is not built like a TV receiver. 

B. The examiner erred in stating that the display in King was 
a liquid crystal display monitor. 

The examiner made this statement in his Final Detailed Action, 
page 2, line 10 under heading Claim Rejections, said page attached 
as part of Exhibit 1. 

Quoting from the text of King (copy of which is attached as 
Exhibit 2), pag.e 3, column 2, lines 47-48: 

"The display panel is preferably of the reconf igurable type 
such as LED, LCD, ELD, etc." 

Note that King put LCD second in a line behind LED, among 
three or more choices. 

So, it is inaccurate for the examiner to state that the 
display in King was a liquid crystal display monitor. It is not 
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necessarily so. 

This examiner is pushing too hard to make the appellant's 
display the same as King. 

C. The examiner erred in concluding that appellant's invention 
was the same invention as King. 

This conclusion is inferred by the examiner's statement/ noted 
above/ that the display of King was a camcorder-type liquid 
crystal display monitor..../ 

And by the examiner's statement/ also noted above/ that 
"Applicant's arguments with respect to claims 3 and 4 have been 
considered but are moot in view of the new ground(s) of rejection." 
(Emphasis added.) 

Quoting from the text of King/ page 3/ column 1, line 51: 

"The present invention provides information to the operator 
directly vertically above the operator's line of sight to the 
traffic. Thus/ the operator need only look slightly vertically 
upwardly. The panel is preferably incorporated into the visor. 
The information is of the type a driver may reference while 
driving forwardlv/ as opposed to backing- up. " ( Emphasis. added . ) 

This quote was from the specification. Now.let us look at 
the claims: From the text of King/ page 4, column 2, line 16: 

"6. A sunvisor as recited in claim 1/ wherein said display 
panel displays information which a driver will access while 
driving forwardly . " (Emphasis added.) 

It is very clear that King's claim pertains only while the 
vehicle is driving forward/ "as opposed to backing up." 

Appellant's claims relate only to backing up. So/ it would 
be impossible for appellant's invention to infringe on King. 
King has staked out the moving forward ground/ and expressly 
showed no interest in the backing of a vehicle/ leaving this 
area open/ to whomever wants to deal with backing up only. 
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It is grossly unjust for this examiner to conclude that 
appellant's invention is the same as King. 

D. Examiner erred in not finding King inoperable as prior 
art/ after appellant gave notice that King's filing date was 
after appellant's filing date for provisional patent application. 

Quoting from applicant's response to the First Office Action, 
page 3, lines 3-7 (attached as Exhibit 5): 

"_1. Inoperative Reference : In regard to: King, the applicant 
respectfully submits that this reference is ineffective, 
because the applicant has an earlier effective filing date, 
due to his Provisional Patent Application 60/071/830, 
filed January 20, 1998." 

The copy of the patent of King, which is attached as Exhibit 
2, shows that the filing date was June 16/ 1998. 

Attached as Exhibit 6 is copy of the appellant's covering 
letter for filing of the patent application, and in the covering 
letter this statement appears: 

"Pursuant to 35 U.S.C., 119(e)(i), applicant(s) claim 
priority of Provisional Patent Application Ser. Nr. 
60/071,830, filed 1/20/98." 

Attached as Exhibit 7 is copy of the Filing Receipt for 
appellant's patent application showing filing date of 01/15/99, 
and a statement on the Filing Receipt is as follows: 

"Continuing data as claimed by Applicant - Provisional 
Application No. 60/071,830, 01/20/98. 

E^. Examiner erred in his conclusion that, "Taking the teach- 
ings of King and Frankhouse together as a whole, it would have 
been obvious to one of ordinary skill in the art to modify the 
camera (96) of Frankhouse into the system of King for the same 
purpose of capturing a angle rear view of traffic or objects 
behind the vehicle." 
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Quoting from the text of King, page 3, column 2, line 30: 

"The information displayed is of the sort which a driver 
will need to access while driving forwardly. This is 
contrasted to information only valuable while backing up, 
such as collision avoidance information. While backing up 
information displayed on the sunvisor does not assist the 
operator in not looking away from the driving position . " 
(Emphasis added. ) 

To whomever wrote this specification/ clearly the appellant ' s 
invention was not obvious to the responsible parties, Joseph 
D. King, the inventor, and his "attorney, agent, or firm - 
Howard & Howard," named in the text of King, page 1. 

Here we have a person, or persons, with more than ordinary 
skill in the art to which said subject-matter pertains. 

The person filed for an invention of a display mounted on a 
sunvisor, who had knowledge fresh in his mind about the parameters 
of his invention, in the same general area as the appellant's 
invention; and yet this inventor, and his attorney, agent, or 
firm (all of whom would be professionals) failed to see the 
appellant's invention of using a sunvisor mounted camcorder- 
type liquid crystal display monitor to see while backing up. 

This is very strong evidence that the appellant's invention 
is not obvious. 

2_. Regarding Frankhouse, etal (copy of which is attached as 
Exhibit 8), their invention consists of an LCD monitor mounted 
against the interior surface of the roof of a vehicle, on the 
extreme left side, the extreme right side or in the middle, as 
opposed to mounting on the driver's sunvisor; and this monitor 
is shown in Frankhouse drawings (fig. 2 and fig. 3); and one of 
the stated uses of this monitor is to see while backing up. 

As Fig. 3 and Fig. 4 show, this mount to the roof of the vehicle 
is structurally very different from the appellant's sunvisor mount. 
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3^. The appellant's sunvisor-mounted camcorder-type liquid 
crystal display monitor is an improvement over Frankhouse/ etal/ 
because it allows a direct line of vision, as opposed to an 
angled view. 

When backing to a specific point in a narrow passageway for 
backing, which is common in the trucking industry, the direct, 
line-of-sight viewing is a useful, improvement. 

The appellant's back-up kit includes a reversal switch, 
that reverses the image that the camera sees looking backwards, 
so that it is as if the driver were looking directly into a rear- 
view mirror, as he is backing. The appellant's monitor assembly 
makes it easier for new drivers to learn to back with skill; 
and there is at present a shortage of skilled truck drivers. 

4. In the appellant's invention, when the sunvisor is pulled 
down, the monitor is completely protected from bright sunlight 
coming through the windshield. Bright sunlight fades a monitor 
picture . 

Whereas, in Frankhouse, etal, the display does not have pro- 
tection from sunlight coming in the windshield. Because of the 
way the corner-mounted display is angled, sunlight will hit its 
screen and fade the picture, or produce glare. Thereby, 
appellant's invention is an improvement over Frankhouse, etal. 

_5. There is a surprising, and unexpected advantage of the appel- 
lant's sunvisor mount, over the Frankhouse interior roof mount, 
at the far left, at the far right, or at the middle. 

Quoting from Consumer Report magazine, july 2001, in an article 
comparing LCD flat panel monitors with standard CRT (cathode ray 
tube) monitor, page 49, column 3, line 10, in square at lower 
right: (Said reference is attached as Exhibit 9.) 

" Unless viewly nearly straight on, flat-panels lose much of 
their contrast ... (Emphasis added.) 

"A CRT's pixels are illuminated differently, producing a 
softer image viewable from virtually any angle." 
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Therefore/ the appellant's sunvisor-mounted / camcorder-type 
LCD monitor assembly is a great improvement over the extreme left 
side/ right side/ or middle roof-mounted LCD monitor of Frankhouse, 
because appellant's invention allows line-of -sight / direct view 
to the back/ without lost of picture contrast, ie t fading/ which 
would occur if one is looking at an LCD screen from an angle. 

6. The essense of the King invention was that the sunvisor-mounted 
display allowed the driver to view information (information also 
appearing on the dashboard to his lower right) pertaining to 
operation of the vehicle/ while: .keeping his eyes on the road while 
only looking slightly upward at the sunvisor-mounted display/ 
and not having to look away from the road to view the dashboard to 
his lower right. 

In summary/ in King/ the driver can look toward the road ahead/ 
not having to look away. The U.S. Patent Office granted King a 
patent . 

In appellant's invention/ the driver can look directly ahead 
and see what is directly behind/ not having to look away. The 
same standard should be applied to the appellant'-s invention/ as 
was applied in King. 

2- If the appellant's sunvisor-mounted/ camcorder-type LCD monitor 
assembly were in fact obviouS/ because of its advantages noted 
above/ those skilled in the art surely would have implemented it. 
That is — the fact that those skilled in the art have not 
implemented the invention/ despite its great advantages/ indicates 
that it is not obvious. 

F. Examiner erred in his conclusion that/ "Taking the teachings 
of Abersfelder et al and Aviv together as a whole, it would have 
been obvious to one of ordinary skill in the art to modify the 
pin hole lens of Aviv into the system of Abersfelder for the same 
purpose of seeing through the predetermined sized hole of 
license plate . " 
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1. License plates already have drilled holes/ on the corners/ 
for bolts to pass through. Drilling a hole through the center 
of a license plate is unusual. 

Furthermore/ the drilled hole has to be ground down on the 
back side/ to eliminate all traces of rough edges. 

For maximum concealment of the micro-video/ pinhole lens 
camera, the camera needs to be glued to the plate, not bolted. 

The glue is ideal to set a tight seal between the camera lens 
housing and the rear of the license plate. But unforeseen 
problems arise which will make persons think twice before mount- 
ing a pinhole lens camera on the back of a license plate. 

The glue/ or glues, chosen must make a waterproof seal and 
must hold the seal during extremes of cold and heat. Many glues 
accomplish one end/ but not the other. 

Unless one is careful/ applying too much glue can spread the 
glue over the tiny pinhole lens opening, causing havoc. 

Glues capable of holding a waterproof seal and of holding 
during extremes of heat and cold will bond so that the pinhole 
lens camera can never be removed from the back of the license 
plate/ without damage to the camera. 

Although nowadays/ states do not issue yearly changes of 
license plates, and vehicles keep the same plates for years, the 
consequences of not being able to remove the camera would keep 
the ordinary person versed in the art from rushing to mount a 
micro-video/ pinholed lens camera on the back of a trailer 
license plate. This just is not an obvious thing to do. 

Only those who appreciate the risk of vandalism of an exotic 
looking gadget, mounted in plain sight/ on the back of a freight 
trailer, frequently parked unattended in urban, industrial areas, 
will see that the concealment afforded the plate-mount helps to 
solve a longstanding problem in the trucking industry — safe, 
easy, accurate backing without using a gadget that will attract 
vandals. And concealment is not easy. The camera must be hidden 
behind something thin/ so the field of view is not overly diminish- 
ed/ and the concealing surface must be something ordinary/ like a 
license plate. 
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2, A copy of Abersfelder/ etal (US 5/940,120) is attached 
as Exhibit 10. 

(a) Its camera system is greatly different in structure and 
much more complex than the appellant's plate-mounted/ pinholed 
lens micro-video camera. 

(b) In order for the camera to swing back and forth in an 
arc/ part of the camera is exposed to anyone's view at the back 
of the car. The camera is not the pinhole type. Also, the side 
distance detecting sensors are exposed. 

These features are shown in fig. 2 (21.1 and 21.2 distance 
detecting sensors, 20. A and 20. B bounding beams, and 11 camera). 

(c) The camera system is designed for an expensive car, like 
a Mercedes Bens (the car company is the assignee), that normally 
will be parked at night in a garage, not outdoors in an urban, 
industrial area where vandalism is a problem. 

(d) Appellant's invention has advantages over Abersfelder, 
in that it is simple, suitable for the trucking industry, and 
conceals the camera behind the rear license plate of a freight 
trailer. The license plate is so commonplace that it does not 
draw attention, and yet the plate is thin enough to allow a 
wide field of view for the concealed pinhole camera lens. 

Nothing else at the back of a freight trailer, at the ideal 
height/center position has these two requisites. 

This ideal height/center position allows the camera a direct 
view to the loading platform. 

This direct, 1 ine-of -sight view, is especially important when 
a tractor/trailer rig is backing up to a loading dock that is 
fairly close to the street. The trailer may be in the driveway, 
facing south, while the tractor is still in the street facing 
east, for example. Yet with appellant's invention, the driver 
can clearly see what is directly behind his trailer, facing 
south. This is really an astounding improvement. 
_3. A copy of Aviv (US 5,666,157) is attached as Exhibit 11. 
In his Final Detailed Action the examiner referred to column 9, 
lines 54-65 of Aviv. 

(a) Aviv has to do with a pinhole lens camera attached, eg, 
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to the rear view mirror in the driving compartment of a car, 

and it takes a picture of a thief in the front seat who is 

trying to steal the car, and it transmits this picture to 

police headquarters . 

Aviv is a far cry from the appellant's simple invention to 

conceal a pinholed lens micro-video camera at the back of a 

freight trailer. 

Appellant contends an ordinary person skilled in the art 

would not think of appellant's invention after being exposed 

to Aviv and Abersfelder. 
4. If the appellant's plate-mounted, pinholed lens micro-video 
camera assembly, at the back of a freight trailer, were in fact 
obvious, because of its advantages noted above, those skilled in 
the art surely would have implemented it. That is — the fact 
that those skilled in the art have not implemented the invention, 
despite its great advantages, indicates that it is not obvious. 

All the Exhibits, 1-11, are incorporated by reference into 

this brief- 
In regard to Grouping of claims, noted on page 2 of this brief, 

explanation is given as follows: 

Appellant considers that his two claims are independent claims 

but that they complement each other. 

Each claim provides a phrase that links it to the other claim. 

To wit: "when used in conjunction with a video camera", and 

"when used in conjunction with a monitor". 

The term Kit in the title of the invention implies more than 

one compontent- 

The appellant notes that in Abersfelder, etal, attached as 

Exhibit 10, the one patent covers both a camera at the back of 

the vehicle and a monitor in the middle console area of the 

driving compartment . 

WHEREFORE, appellant prays that the Board will rule in 
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appellant's favor/ and instruct the examiner to proceed with 
the issuing of a patent to the appellant/ including the two 
claims fought for by the appellant. 

Very respectfully submitted/ 

Rolf Jansen 
Appellant/ pro se 
P. O. Box 73161 
Houston, TX 77273-3161 

281-440-6907 

Certificate of Mailing 
I certify that this correspondence will be deposited with the 
United States Postal Service as first class mail with proper 
postage affixed in an envelope addressed to "Assistant Commis- 
sioner for Patents/ Washington, DC 20231" on the date below. 


Date: 08/27/01 
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Rolf Jansen 



3. An assembly of a camcorder-type liquid crystal display 
monitor/ comprising means for mounting said assembly to 
the inner retracted side of a driver's sunvisor of a motor 
vehicle, 

whereby said sunvisor, when lowered, allows a driver easy, 
direct, close-range, sunlight-protected viewing of said 
monitor screen, as if the screen were a rear-view mirror, 
when used in conjunction with a video camera, to see to 
the rear when the unaided view is obstructed. 


4. An assembly of a micro-video, pin-holed lens camera, 

comprising means for mounting said assembly on the reverse 
side of a plate, such as a license plate, at the rear of 
a trailer or motor vehicle, so that said camera can see 
through a predetermined-sized hole put in said plate, 

whereby said plate-mounted assembly conceals said pin-holed 
lens camera to lessen the risk of vandalism, 

whereby said camera is located in the ideal position at the 
rear of a trailer or motor vehicle for viewing a backing, 
when used in conjunction with a monitor. 


§1.192 


37 CFR Ch, I (7-1-00 Edition) 


the Federal Circuit or for commencing 
a civil action. 

(e) Jurisdiction over the application 
or patent under reexamination passes 
to the Board of Patent Appeals and 
Interferences upon transmittal of the 
me, Including all briefs and examiner's 
answers, to the Board. Prior to the 
entry of a decision on the appeal, the 
Commissioner may sua sponte order 
the application remanded to the exam- 
iner. 

(35 U.S.C. 6. Pub. L. 97-247; 15 U.S.C. 1U3. 
1123) 

[46 PR 29183, May 29, 1981, as amended at 49 
PR 555, Jan. 4, 1984; 49 FR 48453. Dec. 12. 1984; 
54 FR 29552, July 13, 1989; 58 FR 54510. Oct. 22. 
1993; 62 FR 53196, Oct. 10. 1997] 

S 1.192 Appellant's brief. 

(a) Appellant must, within two 
months from the date of the notice of 
appeal under §1.191 or within the time 
allowed for reply to the action from 
which the appeal was taken, if such 
time is later, file a brief in triplicate. 
The brief must be accompanied by the 
fee set forth in § 1.17(c) and must set 
forth the authorities and arguments on 
which appellant will rely to maintain 
the appeal. Any arguments or authori- 
ties not included in the brief will be re- 
fused consideration by the Board of 
Patent Appeals and Interferences, un- 
less good cause is shown. 

(b) On failure to file the brief, accom- 
panied by the requisite fee, within the 
time allowed, the appeal shall stand 
dismissed. 

(c) The brief shall contain the fol- 
lowing items under appropriate head- 
ings and in the order indicated below 
unless the brief is filed by an applicant 
who is not represented bv a registered 
practitioner; 

(1) Real party in interest A statement 
identifying the real party in interest, if 
the party named in the caption of the 
brief is not the real party in interest. 

(2) Related appeals and interferences. A 
Statement identifying by number and 
filing date all other appeals or inter- 
ferences known to appellant, the appel- 
lant's legal representative, or assignee 
which will directly affect or be directly 
affected by or have a bearing on the 
Board's decision in the pending appeal, 

(3) Statiis of claims, A statement of 
the status of all the claims, pending or 


cancelled, and identif3ring the claims 
appealed. 

(4) Status of amendments. A statement 
of the status of any amendment filed 
subsequent to Hnal rejection. 

(5) Summary of invention. A concise 
explanation of the invention defined in 
the claims involved in the appeal, 
which shall refer to the specification 
by page and line number, and to the 
drawing, if any, by reference char- 
acters. 

(6) Issues. A concise statement of the 
issues presented for review. 

(7) Grouping of claims. For each 
ground of rejection which appellant 
contests and which applies to a group 
of two or more claims, the Board shall 
select a single claim firom the group 
and shall decide the appeal as to the 
ground of rejection on the basis of that 
claim alone unless a statement is in- 
cluded that the claims of the group do 
not stand or fall together and, in the 
argument under paragraph {c)(8) of this 
section, appellant explains why the 
claims of the group are believed to be 
separately patentable. Merely pointing 
out differences in what the claims 
cover is not an argument as to why the 
claims are separately patentable. 

(8) Argument The contentions of ap- 
pellant with respect to each of the 
issues presented for review in para- 
graph (c)(6) of this section, and the 
basis therefor, with citations of the au- 
thorities, statutes, and parts of the 
record relied on. Each issue should be 
treated under a separate heading. 

(i) For each rejection under 35 U.S.C. 
112. first paragraph, the argument shall 
specify the errors in the rejection and 
how the first paragraph of 35 U.S.C. 112 
is complied with, including, as appro- 
priate, how the specification and draw- 
ings, if any, 

(A) Describe the subject matter de- 
fined by each of the rejected claims, 

(B) Enable any person skilled in the 
art to make and use the subject matter 
defined by each of the rejected claims, 
and 

(C) Set forth the best mode con- 
templated by the inventor of carrying 
out his or her invention. 

(ii) For each rejection under 35 U.S.C. 
112. second paragraph, the argument 
shall specify the errors in the rejection 
and how the claims particularly point 
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^ DETAILED ACTION 

^'^rHAOi>^^^ Drawings 
The corrected or substitute drawings were received on 9/6/00. These drawings are approval. 

Response to Arguments 
1 . Applicant's arguments with respect to claims 3 and 4 have been considered but are moot 
in view of the new ground(s) of rejection. 


Claim Rejections - 35 USC § 103 

1 . The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all 
obviousness rejections set forth in this Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in 
section 102 of this title, if the differences between the subject matter sought to be patented and the prior art are 
such that the subject matter as a whole would have been obvious at the time the invention was made to a person 
having ordinary skill in the art to which said subject matter pertains. Patentability shall not be negatived by the 
manner in which the invention was made. 

2. Claim 3 is rejected under 35 U.S.C. 103(a) as being unpatentable over King (US 
5,971,468) in view of Frankhouse et al. (US 5,940,120). 

'Re claim 3, King discloses an assembly of a camcorder-type liquid crystal display 
monitor (26 of fig. 1) is mounted to the inner retracted side of a driver sunvisor (24 of fig. 1) of a 
vehicle (20 of fig. 1) when the sunvisor is lowered allows a driver easily direct, close-range, 
sunlight-protected viewing of the monitor screen, the display monitor is connected to a 
navigation system to display a navigation information. 

It is noted that King discloses the display monitor is connected to the navigation system 
but King fails to particularly connect to a video camera to see to the rear when the unaided view 
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is obstructed. However, Frankhouse teaches a LCD display (90 of fig. 6) is mounted to the 
compartment (124 of fig. 6) of the vehicle to display information of a rear view captured by a 
video camera (96 of fig. 10). Taking the teachings of King and Frankhouse together as a whole, 
it would have been obvious to one of ordinary skill in the art to modify the camera (96) of 
Frankhouse into the system of King for the same purpose of capturing a angle rear view of traffic 
or objects behind the vehicle. Doing would allow the driver see a various locations around 
vehicle without turning his/her head around. 

3. Claim 4 is rejected under 35 U.S.C. 103(a) as being unpatentable over Aberfelder et al. 
(US 5,646,614). 

Re claim 4, Abersfelder discloses a camera (1 1 of fig. 1) is built in and located on the 
back of a car (10 of fig. 1), whereby said camera is located in the ideal at rear of the car for 
viewing a backing and connected to a monitor (15 of fig. 1), and wide angle lenses are used in 
this particular camera to receive a wide view image. It is noted that Abersfelder fails to 
particularly disclose the camera is mounted on the reverse side of a license plate at the rear of 
vehicle so that the camera can see through a predetermined-sized whole put in the license plate. 
However, it is well established that one skilled in the art would have obvious to mount the 
camera anywhere on the car, particularly on the reverse side of a license plate at the rear of the 
vehicle, and the camera can see through a predetermined-sized hole put in the license plate a rear 
view when the vehicle is backing. 

Abersfelder further teaches any conventional and suitable camera lenses, camera lenses 
of very compact construction can be used, without the requirement of extending the camera 
purposes of realizing a sufficient viewing angle (col. 2, lines 16-25). However, Abersfelder does 
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not particularly disclose a pin hole lens which is used for a camera. Aviv teaches a pin hole lens 
is used for a camera (col. 9, lines 54-65). Taking the teachings of Abersfelder et al and Aviv 
together as a whole, it would have been obvious to one of ordinary skill in the art to modify the 
pin hole lens of Aviv into the system of Aberfelder for the same purpose of seeing through the 
predetermined sized hole of license plate. 


Conclusion 

4. Applicant's amendment necessitated the new ground(s) of rejection presented in this 
Office action. Accordingly, THIS ACTION IS MADE FINAL. See MPEP § 706.07(a). 
Applicant is reminded of the extension of time policy as set forth in 37 CFR 1.136(a). 

A shortened statutory period for reply to this final action is set to expire THREE 
MONTHS from the mailing date of this action. In the event a first reply is filed within TWO 
MONTHS of the mailing date of this final action and the advisory action is not mailed until after 
the end of the THREE-MONTH shortened statutory period, then the shortened statutory period 
will expire on the date the advisory action is mailed, and any extension fee pursuant to 37 
CFR 1.136(a) will be calculated from the mailing date of the advisory action. In no event, 
however, will the statutory period for reply expire later than SIX MONTHS from the date of this 
final action. 
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ABSTRACT 


A display panel for displaying information to a vchide 
operator is placed on a rear surface of a sunvisor for the 
vehicle. The di^lay panel is hidden when the simvisor is 
moved to a stowed position but is easily accessible to the 
operator when the sunvisor is moved to its extended posi- 
tion. The location of the display panel on the sunvisor allows 
the operator easy access to the information without diverting 
information from the road. In addition, control buttons are 
associated with the display panel such that the operator is 
able to adjust the information displayed on the panel, or to 
adjust a component for responding to the information dis- 
played on the panel 

6 Claims, 1 Drawing Sheet 
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1 

INCORPORATION OF VEHICLE DISPLAY 
INTX) VEHICLE SUNVISOR 

BACKGROUND OF THE INVENTION 

This inveDtion relates to a combined vehicle sunvisor and 5 
display panel. 

Vfehicles arc being supplied with more and more displays 
to provide information to an operator. As an example, 
information with regard to the current operating condition of 
the vehicle, such as speedometer, fuel gauge, oil 
temperature, etc. have historically been provided to a vehicle 
operator More recently, new products such as vehicle navi- 
gation systems have provided additional information to the 
operator. Further, environmental control systems such as 
temperature, air conditioniag, lights, radio and other enter- 
taiimient information are also provided to the operator. 

The increase in the amount of information provided to the 
operator has resulted in a situation wherein there are many 
display areas on the instrument panel of the vehicle. Many 
of these areas are in a location wherein the driver must look ^ 
away to access the information, sudi that the driver's 
attention is not on the road. 

Many of the prior art display panels are in a location 
where the operator must look away from the road in more ^ 
than one axes. As an example, mauy display panels are 
positioned spaced towards the passenger seat from the 
driver, and at a vertical location beneath the windshield. 
Thus, the operator must look vertically downwardly, and to 
the right to see the information. ^ 

Moreover, many of these di^lays are associated with 
control buttons to change the state of the information 
displayed (i.e., radio volume, etc.). Again, if the operator's 
attention is diverted from the road to control these switches, 
the results may be undesirable. 35 

It is therefore an object of this invention to provide an 
information display and associated control that does not 
remove the operator's line of vision from the road. 

SUMMARY OF THE INVENTION 

40 

In a disclosed embodiment of this invention, a display 
panel is positioned on a rear surface of a sunvisor. The 
simvisor is of the type which is pivoted downwardly into the 
driver's view, at a location adjacent the vertically upper end 
of the windshield. In this way, when the operator wishes to 45 
view information on the sunvisor, the sunvisor may be 
simply pivoted to the down position, and the information is 
directly in the hne of sight of the operator. The operator may 
only need to look up sUghtly, and need not look to the side 
to gain access to the information. 50 

The present invention provides information to the opera- 
tor directly vertically above the operator's line of sight to the 
trafSc. Thus, the operator need only look slightly vertically 
upwardly. The panel is preferably incorporated into the 
visor. The information is of the type a driver may reference 55 
while driving forwardly, as opposed to backing up. 

In other preferred embodiments of this invention, control 
buttons to control the information displayed on the display 
panel are also provided adjacent to the display panel. These 
controls can also be provided by touch screen menu areas. 60 
As an example, the display buttons may be controls to adjust 
the level of volume for a radio, should the radio be the 
information displayed on the rear of the sunvisor. The 
controls necessary for achieving selective control of the 
information displayed are known. It is the inclusion of the 65 
display panel and the controls on the rear of the sunvisor 
which is the inventive feature of this application. 
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These and other features of this invention may be under- 
stood from the following specification and drawings, the 
following of which is a brief description. 

BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a schematic view of a vehicle windshield, 
FIG. 2 is an enlarged view of a sunvisor incorporated into 

the FIG. 1 vehicle windshield. 

FIG. 3 is a view similar to FIG. 2, but showing a 

subsequent display. 

DETAILED DESCRIPTION OF A PREFERRED 
EMBODIMENT 

A vehicle cab 20 is shown in FIG. 1 incorporating a 
window glass 22 which shows the road hne of sight to the 
operator. A sunvisor 24 is shown pivoted to a downward 
position, and a display panel 26 is shown in FIG. 1 on the 
rear of the sunvisor 24. The display panel 26 is shown 
displaying speed information, such as typically displayed in 
the instrument panel. The front of the sunvisor faces out- 
wardly of the vehicle and blocks sunshine into the vehicle. 

The sunvisor 28 is pivoted to a slowed position, again as 
known. Visor 26 may also move to this stowed position. 

The location of the steering wheel 30 gives a perspective 
of the location of the operator's hne of sight. The sunvisor 
display panel 26 is in a location such that the operator need 
only avert his eyes slightly vertically upwardly to gain 
access to information displayed on panel 26. 

The information displayed is of the sort which a driver 
will need to access while driving forwardly. This is con- 
trasted to information only valuable while backing up, such 
as colhsion avoidance information. While backing up infor- 
mation displayed on the sun visor does not assist the'^ 
operator in not looking away from the driving direction. 

As shown in FIG. 2, the sunvisor 24 incorporates the 
panel 26. A pivot post 31, which is well known in the art, 
passes electrical signals to and from the sunvisor. Wires 33 
are shown schematically for transmitting this information to 
and from the display 26 and controls on the vehicle. 
Typically, the sunvisors have been provided with illumi- 
nated lights, but no display panel. Thus, the provision of 
electrical signals to and from the sunvisor is known. It is the 
use of the display panel with the signals passing through the 
pivot post which is unique in this invention. While control 
buttons 32 are shown, it should be understood that touch 
screen controls can be used. The display panel is preferably 
of the reconfigurable type such as LED, LCD, ELD, etc. 

Controls, such as buttons 32 allow an operator to select 
what type of information is displayed, and also adjust 
variables. As an example, the operator may select from 
interior comfort options such as radio, hghting temperature, 
or navigation information. If the driver actuates the radio 
button as shown in FIG. 2, then the display moves to a radio 
control display, such as shown in FIG. 3. The operator can 
manipulate the buttons to select radio information to be 
displayed. The operator will then be able to adjust aspects of 
the radio such as volume or tuning. Thus, the operator is able 
to adjust the radio without diverting his attention from the 
road other than to look slightly vertically upwardly to the 
display panel 26. The controls to achieve this adjustment are 
known, it is the provision of such features into the sunvisor 
which is inventive. Further, the displays illustrated in the 
Figures are simplified to allow early understanding of the 
basic concepts. 

The present invention provides an additional area for 
display which is easily accessible to the operator, without 
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diverting atteDtion from the road. The present invention thus 
is a great improvement upon the prior art. A worker of 
ordinary skill in the art would recognize that certain modi- 
fications oome within the scope of this invention. For that 
reason, the following claims should be studied to determine 
the true scope and content of this invention. 

What is claimed is: 

1. A vehicle cab comprising 

a front windshield, and at least one sunvisor, said suovisor 
having a mount structure to be moimted to a roof of said 
vehicle, said sunvisor being pivotable between a 
stowed position wherein a first surface faces into said 
cab, and a second surface faces said ceiling, and said 
sunvisor being movable to a extended position wherein 
said second surface faces into said cab and said first 
surface faces outwardly through said windshield; and 

a display panel being connected to said second surface, 
said display panel being connected to a control on said 
vehicle to display information relative to the operation 
of at least one component of said vehicle. 
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2. A vehicle cab as recited in claim 1, wherein said 
simvisor is attached to said vehicle by a pivot post, and 
control wires extending through said pivot post to said 
display panel. 

3. A sunvisor as recited in claim 1, wherein control 
switches are provided adjacent to said display panel to allow 
an operator to control information which is displayed on said 
display panel. 

4. A sunvisor as recited in claim 1, wherein said display 
panel is a reconfigurable display panel. 

5. A sunvisor as recited in claim 1, wherein signals wires 
extending to said display panel pass through a pivot post for 
said sunvisor. 

6. A sunvisor as recited in claim 1, wherein said display 
panel displays information which a driver will access while 
drivirig forwardly. 
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electrical joints, on PCBs and elsewhere, are made with solder, 
for general purposes is a 60/40 alloy of tin and lead with a 
ng point around ISS'C. For applications where operating 
•ratures may approach this, high melting point (HMP) solders 
vailable. Solders are generally prepared in wire form with one 
>re internal coi«s of non-corrosive flux. For general serviqing 
•ses 18 or 22 s.w.g. is suitable, though finer grade (26 s.w.g.) is 
i for fine work and for rework of SM PCBs. Special-purpose 
rs also relevant to these are various preforms, and solder paste, 
lich tiny globules of solder are suspended in a semi-liquid flux 
dispensed onto the board as required during manufacture or 
r. in the latter case from a syringe. All soldering is accompanied 
uxing, the application of an agent (e.g. resin) to remove oxides 
the surfaces of both metals to be bonded. 


Chapter 2 

TV AND VIDEO WAVEFORMS AND STANDARDS 


'Television' and 'video' are wide-ranging words. For our purposes, 
television means seeing over long distances by means of an electncal 
link and video (in the everyday usage of the word) means a record- 
ing and playback system with which TV programmes can be stored 
on disc or magnetic tape for subsequent replay via a TV set or moni- 
tor In analogue systems the picture information is conveyed as an 
electrical waveform. Since a single link between TV sender and 
receiver can only handle one signal at a time, and because a TV picture 
consists of many hundreds of thousands of individual picture ele- 
ments, a scanning system is required at each end. At the sending end 
it breaks down the composite picture into separate picture elements 
which are then sequentially transmitted. At the receiving end this 
'serial' video signal is used to modulate the light output of the display 
in order to recreate the original scene. Provided that the scanmng 
system at the receiver runs in perfect synchronism with that at the 
transmitter the positioning of each picture element m the display will 
be correct, and a complete two-dimensional picture is bmlt up. 

The fidelity of the reproduced picture depends on many things The 
scanning process consists of analysing the picture m terms of 
horizontal lines: the duration and number of these hnes is the basic 
arbiter of picture definition and quaUty. Many other factors are 
Dtesent such as the bandwidth of the entire video path from camera 
to picture tube; the screen structure of a colour display tube; the 
method of encoding the colour signal, and so on. 

SCANNING STANDARDS 

The number of horizontal scanning lines used in TV picture analysis is 
a fundamental characteristic of a TV standard. So far as line standards 
are concerned there are now only two in general broadcast use - 525 
lines in the Americas, Greenland and Japan, and 625 lines elsewhere, 
including Eastern and Western Europe. Africa and Australia. More 
specific details appear later in this chapter. Of course the number of 
lines only describes how each stationary picture is analysed. For mov- 
ing pictures it is necessary to present a series of frames at a rate which 
will fool the human eye into believing that it perceives continuous move- 
ment- and which avoids noticeable flicker. This depends for its success 


on 'persistence of vision', that characteristic of the eye which retains 
an impression of an image for a fraction of a second after the object 
itself has disappeared. A series of still images presented at a rate of 
about 14 per second would provide an illusion of continuous move- 
ment, but would give rise to a very distracting flicker. Increasing the 
rate to 25 per second would reduce the effect but not eliminate it. A 
repetition rate of 50 per second is satisfactory for most purposes, though 
60 is better, especially where the picture is bright. For historical reasons 
having to do with the frequency of the public electricity supply, 625 
line systems generally have a 50 Hz field rale, while 525 line systems 
have a 60 Hz field rate. 

Taking the European 625/50 standard as an example, then, the 
requirement is for the picture to 'light up' 50 times per second to 
avoid a bad flicker effect. Since 25 pictures per second are adequate 
to fulfil the continuous movement requirement, however, it would be 
wasteful of bandwidth and broadcast spectrum space to transmit 50 
complete pictures per second. The problem is neatly solved by the 
adoption (universal for broadcast TV) of interlaced scanning. In this 
system, instead of transmitting each line of the picture in sequence 
(Fig. 2.1(a)) the first vertical scanning sweep is done at twice-speed, 
as it were. The left-to-right scan-line paths are double spaced as a 
result, and so only 312V2 lines (half the total of 625) are traced out, 
corresponding to hnes 1, 2, 3, 4 etc. in Fig. 2.1(b). The second verti- 
cal sweep, by virtue of a very precisely timed start point, scans the 
gaps left between the lines of the first field - lines A, B, C and D in 
Fig. 2.1(b). By this means, although only 25 complete pictures 
(frames) are presented per second, the entire screen is scanned 50 
times (50 fields) per second. Since at normal viewing distances 
individual scanning lines are not perceptible, the effect is to secure a 
50 Hz flicker rate while using no more video or spectrum bandwidth 
than required for a 25 fields/second sequentially scanned system. 

THE VIDEO SIGNAL 

A standard video signal is an electrical analogy of the brightness of 
the TV picture at the point on the screen being described at that 
instant. The brighter the picture-point the higher the voltage, with 
* peak- white' - corresponding to maximum drive - being standardised 
at the level of + 1 V Black is standardised at 0.3 V (300 mV). All the 
levels of grey therefore fall between these two voltages, and where a 
lot of detail is present in the scene the video voltage will very quickly 
alternate between different levels, giving rise to high frequencies in 
the video waveform. The range of possible frequencies goes from zero 
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j Fig. 2.1 TV scanning: (a) sequential; (b) interlaced 

(dx.) when an even tone (i.e. all black, all grey, all white etc.) is 
transmitted, up to about 5.5 MHz for a fine network of vertical 

i and white bars. Three lines of a TV waveform are shown in Fii 
Along with the video signal itself synchronising pulses must b 
to keep the scanning at the receiver in step with that in the cai 
The *blacker than black' area between 0 V and 0.3 V is reser\ l 

I sync pulses - two types are sent, one at 64 ^s intervals to triggt 
line scan generator, and one at 20 ms intervals to synchronise 
scanning sweeps In the receiver these pulses are stripped off the 
signal by an ampUtude limiter (sync separator) and then spli 

] line- and field-rate pulses by frequency (time)-conscious circuii 
A section of this basic waveform, showing one complete line p 
of 64 is shown in Fig. 2.3. It is made up of 52 jis of pi 
information and a 12 |is line blanking period. The time-refe 

I point for the whole waveform is the beginning of the 4.7 ^s line 
pulse. Following the pulse is a *back porch' period of 5.8 d 

J which the waveform remains at black level. At the finish of p: 
information comes a *front porch' of 1.55 \xs. This short blai 



Fig. 2.2 Basic video waveform. The voltage is analogous i 
strength of light 
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and via mirrors. Not all scenes are amenable to auto-focusing; 
sometimes the main picture feature is not central in the frame, and 
sometimes a degree of defocusing of some or all of the televised scene 
is required for production or artistic effects. For these reasons, and 
to conserve battery power where applicable, the auto-focus facility 
can be switched off. 

The current trend is to use the video signal itself as reference for 
the auto-focus system as shown in Fig. 6.1 1. It generally gives more 
accurate results, and permits a choice of zone sizes for focus sampling. 


VIEWFINDERS 

The camera's electronic viewfinder (EVF) has three main functions. 
It frames the shot for the operator and checks optical focus during 
shooting; it relays information from the camera's system-control sec- 
tion on settings, status and operational mode; and it acts as picture 
monitor during in-the-field playback in the case of a camcorder. It is 
difficult to manufacture a very small colour screen with good enough 
colour fidelity to accurately judge the picture hue, or with sufficient 
definition to permit accurate optical focusing, especially with high- 
band and digital cameras. 

The norm, then, is a black-and-white viewfinder lube of about 
2.5 cm diagonal mounted in a 'chicken-leg' housing hinged at its back 
end on the top surface of the camera. It has an eyepiece and viewing 
lens with focus adjustment. The display tube is necessarily a low- 
energy device with small deflection angle. As in larger picture tubes, 
magnetic deflection and electrostatic beam- focus systems are used. 
The VF tube is driven by what amounts to a complete monitor circuit, 
including video amplifier and output stage; sync separator; time- 
bases; and high-voltage supplies for the picture-tube, the whole being 
miniaturised and designed to operate from its own (typically 5 V) 
supply rail, derived from the camera's own power supply via a 
stabiliser/regulator circuit. No external controls are needed, though 
brightness and beam-focus controls may be provided as semi- 
accessible presets. This complete independence of the EVF system is 
necessary to enable the viewfinder to perform its role as a video moni- 
tor during tape replay when the camera section is switched off. 
Although physically very small, the components and techniques of 
the EVF are just the same as are used in the TV receiver and moni- 
tors covered in the first half of this book. 


I 

Colour EVF 

The fact that colour viewfinders stniggle to do justice to the peril 
ance of a good video camera has not prevented manufacti 
incorporating them in home-movie camcorders! A few models < 
I the best of both worlds, with a conventional black-and-white VF 
t plus a small (4-10 cm diagonal) colour LCD display in a fold 
1 panel on one side of the camcorder body. In the Viewcam the 
panel of the camcorder consists of a colour LCD panel of 8-1 ( 
diagonal. While suffering from the above-mentioned shortcorr 
as a camera viewfinder, it does have the advantages of not nee 
to be held to the eye while shooting, and of affording more than 
viewer (with difficulty!) to watch the playback on location. A i 
class of camcorder sports a conventional viewfinder housing, b 
contains a mini-LCD panel in place of the little monochrome i 
again with an eyecup and lens. This stretches the cost versus perf 
ance of LCD technology tight, and the *chicken-wire overlay' e 
on the VF image can be very obtrusive. 

VIEWFINDER INDICATIONS 
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generator IC, which may be incorporated in the main processor 

J Working on indications sent to the processor from sensors oi 
tape deck, in the camera section and elsewhere, the character gei 
tor provides a wide range of status, indication and warning sym 
plus - very often - a simple titling facility so that captions and 
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Colour EVF 

The fact that colour ^^ewfinders struggle to do justice to the perf-orm- 
ance of a good video camera has not prevented manufacturers 
incorporating them in home-movie camcorders! A few models ofTer 
the best of both worids. with a conventional black-and-white VF tube 
plus a small (4-10 cm diagonal) colour LCD display in a fold-out 
pane on one side of the camcorder body. In the Vie^.cam the rear 
panel of the camcorder consists of a colour LCD panel of 8-10 cm 
diagonal. While sufTenng from the above-mentioned shortcomings 
' K T""^"^^^- ^^^^ have the advantages of not needing 

to be held to the eye while shooting, and of affording more than one 
viewer (with difficulty!) to watch the playback on location. A third 
Class of camcorder spons a conventional viewfinder housing but it 
I contains a mini-LCD panel in place of the httle monochrorn; tube 
agam with an eyecup and lens This stretches the cost versus perf-orm-' 

^'gh^^ and the 'chicken-wire overlay' effect 
on the VF image can be very obtinisive. 

VIEWFINDER INDICATIONS 

All feedback to the camcorder operator comes via the fiewfinder 
screen, composed and superimposed on the picture by a character- 
generator IC, which may be incorporated in the main processor chip 
Working on indications sent to the processor from sensors on the 
tape deck, in the camera section and elsewhere, the character genera- 
tor provides a wide range of status, indication and warning symbols 
plus - very often - a simple titling facility so that captions and titles 
can be recorded on tape. 

CAMCORDERS 

Camcorders combine the camera principles described in this chapter 
with the videorecorder systems described in Chapters 13-19 of this 
book, and use miniature deck assemblies and (often) small head 
drums. They use either low- or high-band formats (see Chapter 14)' 
and small cassettes of the Video 8 or VHS-C type. Hi-Fi stereo sound 
either in f m. or pulse-code form, is also incorporated in some models' 
Digital cameras will be dealt with in Chapter J 9 

The requirements of small size, light weight and minimum power 
consumption, together uiih competition between makers and formats 
lor the best peribrmance and greatest sophistication, has put cam- 
corders m the forefront of electronic technology. Surface-mounted 
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APPENDIX I 

Displays 


A number of displays can be interfaced with control logic to display numbers, letters, 
special characters, and even graphics. Two popular displays that we'll consider here 
include the light-emitting diode (LED) display and the liquid-crystal display (LCD). 

LI LED Displays 

LED displays come in three basic configurations, numeric (numbers), alphanumeric 
(numbers and letters), and dot matrix forms (see Fig. I.l). Numeric displays consist of 
7 LED segments. Each LED segment is given a letter designation, as shown in the fig- 
ure. 7-segment LED displays are most frequently used to generate numbers (0-9), but 
they also can be used to display hexadecimal (0-9, A, B, C, D, E, F). The 14-segment, 
16-segment, and special 4x7 dot matrix displays are alphanumeric, while the 5x7 
dot matrix display is both alphanumeric and graphic — you can display unique char- 
acters and simple graphics. 


Various types of displays 
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5 X 7 dot matrix 


/. / . / Direct Drive of Numeric LED Displays 

Seven-segment LED displays come in two varieties, common anode and common 
cathode. Figure 1.2 shows single digital 8-segment (7 digit segments + decimal point) 
displays of both varieties. 
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PDSPI880 (Siemens) 8-Character 5 x 7 Dot 
Matrix Alphanumeric Programmable Display 
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FIGURE 1.9 


1.3 Liquid-Crystal Displays 
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In low-power CMOS digital systems (e.g., battery- or solar-powered electronic 
devices), the dissipation of an LED display can consume most of a system's power 
requirements, something you want to avoid, especially since you are looking to save 
power when using CMOSs anyway. Liquid-crystal displays (LCDs), on the other 
hand, are ideal for low-power appHcations. Unlike a LED display, an LCD is a passive 
device. This means that instead of using electric current to generate light, it uses light 
that is already externally present (e.g., sunlight, room lighting). For the LCD's optical 
effects to occur, the external light source need only supply a minute amount of power 
(within the mW/cm' range). 

One disadvantage with LCDs is their slow switching speeds (time it takes for a 
new digit/character to appear). Typical switching speeds for LCDs range from 


TllilP 'i' 


f|f un \\\\\\\\\\}\\ 


'fl'i 


522 Appendix I 


around 40 to 100 ms. At low temperature, the switching speeds get even worse. 
Another problem with LCDs is the requirement that external light be present. 
Though there are LCD displays that come with backlighring (e.g., LED behind the 
display), the backlighting alone tends to defeat attempts at keeping powder consump- 
tion to a minimum. 

1.3. 1 Basic Explanation of How an LCD Display Works 

An LCD disptay consists of a number layers that include a polarizer, a set of trans- 
parent electrodes, a liquid-crystal element, a transparent back electrode, a second 
polarizer, and a mirror. See leftmost figure below. 



Mirror 
Polarizer 2 
Transparent back electrode 
Liquid cr>'siaJ element 
Transparent top electrodes 
Polarizer 1 


BCD 
decoder^ 
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character 



Cutaway view of a reflective-typeLCD 
FIGURE I.IO 


Example circuit showing how to drive LCD 


The transparent top electrodes are used to generate the individual segments of a 
digit, character, etc., while the transparent back electrode forms a common plane, 
often referred to as the back plane (BP). The top electrode segments and the back elec- 
trode are wired to external contacts. With no potential difference between a given top 
electrode and the back electrode, the region where the top electrode is located 
appears silver in color against a silver background. However, when a potential is 
applied bet^veen a given top electrode and back electrode, the region where the top 
electrode is located appears dark against a silver background. 

The circuit in Fig, 1.10 shows a simple way to drive a 7-segment LCD. It uses a 
74HC4511 BCD decoder and XOR gates to generate the prior drive signals for the 
LCD. A very important thing to note in this circuit is the clock. As it turns out, an 
LCD actually requires ac drive signals (e.g., squarewaves) instead of dc drive sig- 
nals. If dc were used, the primary component of the display, namely, the liquid 
crystal, w^ould undergo electrochemical degradation (more on the liquid crystal in 
a moment). The optimal frequency of the applied ac drive signal is typically from 
around 25 Hz to a couple hundred hertz. Now that we understand that, it is easy 
to see why we need the XOR gates. As the clock delivers squarewaves to the back 
electrode (back plane, or BP), the XOR gates act as enable gates that pass and 
invert a signal and apply it to a given top electrode segment. For example, if a 
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In the United Slates Patent and Trademark Office 


Serial Number: 
Appn. Filed; 
Appltcant(s): 
Appn. Title: 
Examiner/GAU: 


09/232,565 


01/15/99 


Rolf Jansen 


Tract or /Trailer Back-up Kit 
Tung Vo/ Group Art Unit 2713 

Mailed: 
At: 


January 2 / 2001 
Houston r TX 


Amendment _a 

Assistant Commissioner for Patents 
Washington. District ot Columbia 20231 

Sir: 

In response to the Office Letter mailed August 2 / 2000 ^ piggjg grngnd the above application as follows: 

Claims : Cancel all claims of record and substitute new 
claims 3 and 4 as follows: 

3, An assembly of a camcorder- type liquid crystal display 
monitor/ comprising means for mounting said assembly to 
the inner retracted side of a driver's sunvisor of a 
motor vehicle / 

whereby said sunvisor/ when lowered / allows a driver 
easy/ direct/ close- range/ sunlight-protected viewing 
of said monitor screen/ as if the screen were a rear- 
view mirror/ when used in conjunction with a video 
camera , to see to the rear when the unaided view is 
obstructed . 

4 . An assembly of a micro-video / pin- ho led lens camera / 
comprising means for mounting said assembly on the 
reverse side of a plate, such as a license plate/ at 
the rear of a trailer or motor vehicle/ so that said 
camera can see through a predetermined-sized hole put 
in said plate / 

whereby said plate-mounted assembly conceals said pin- 
holed lens camera to lessen the risk of vandalism. 


Appn. Number 09/232/566 (Rolf Jansen) GAU 2713 Amnt A 2 


whereby said camera is located in the ideal position at the 
rear of a trailer or motor vehicle for viewing a backing, 
when used in conjunction with a monitor. 

REMARKS 

Applicant wishes to thank the Examiner for sending the 
copies of the references. 

Applicant submitted corrected drawings NO. 1-5 that were 
received in the Patent Office on August 30/ 2000. 

Applicant filed a Petition for Extension of Time 
(2 months) that was received in the Patent Office on 
October 17/ 2000. 

Applicant has rewritten all claims to define the invention 
more particularly and distinctly so as to overcome the 
technical rejections and define the invention patentably 
over the prior art. 

Claims objections : Applicant has made the appropriate 
correction/ in Claim 2/ line 1/ to change "enclosure for" 
to "assembly of". 

Applicant changed also the wording of Claim 1/ in order 
to use the better term "assembly of". 

Summary of Claims Rejection 

Claims 1 and 2 were rejected under U.S.C. 103(a) as being 
unpatentable over Yang (US 5/615/023) in view of King 
(US 5/971/468) . 
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Response Regarding Claim 1 

_1. Inoperative Reference : In regard to King/ the applicant 
respectfully submits that this reference is ineffective, 
because the applicant has an earlier effective filing date, 
due to his Provisional Patent Application 60/071/830, 
filed January 20, 1998. 

2. U nsuggested Combination : The prior-art references (King 
and Yang) do not contain any suggestion (express or implied) 
that they be combined, or that they be combined in the 
manner suggested, 

3. Solved Different Problem : Applicant's invention solves a 
different problem than the reference (King), and such dif- 
ferent problem is recited in the claims. In re Wright / 

6 USPQ 2d 1959 (1988) . 

Applicant's sunvisor-mounted display is a video display 
capable of showing moving pictures of the scene outside and 
behind the trailer. 

The King display provides information that is ordinarily 
found on the instrument panel of the vehicle/ in the various 
gauges/ showing the operating condition of the vehicle. 

4. New Principle of Operation ; The invention utilizes a new 
principle of operation. Applicant has blazed a new trail/ 
rather than followed one. 

Yang claims a display comprising a hologram optical system 
and a holographic combiner. 

Applicant's display has nothing whatsoever to do with the 
principle of a hologram. Applicant's display is based on 
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the principle of the camcorder-type liquid crystal display 
monitor/ that is small and thin and capable of being mount- 
ed on a sunvisor. 

5. Made Simpler : A prior-art version has been made simpler 
without loss of capability. 

Applicant's display, using a camcorder-type LCD monitor, 
is much more simple, and presumably much more cost effec- 
tive, than the complex holographic display of Yang. 

Applicant's sunvisor-mounted display is a novel improve- 
ment over the complex holographic display of Yang; and the 
advantages are stated in applicant's claim: 

"...whereby said sunvisor-, when lowered, allows a driver 
easy, direct, close-range, sunlight-protected viewing of 
said monitor screen, as if the screen were a rear-view 
mirror, when used in conjunction with a video camera, to 
see to the rear when the unaided view is obstructed." 

6. Lack of Implementation : If applicant's sunvisor-moun ted 
video display were in fact obvious, because of its advan- 
tages noted above, those skilled in the art surely would 
have implemented it by now. That is — the fact that those 
skilled in the art have not implemented the invention, 
despite its great advantages, indicates that it is not 
obvious . 

Therefore, applicant submits that Claim 1 is allowable 
over cited references and solicits reconsideration and 
allowance in its rewritten form as Claim 3. 
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Response Regarding Claim 2 

1_. Background To The Legal Arguments Which Will Follow : 
The main attribute of the applicant's plate-mounted 
assembly (micro-video, pin-holed lens camera) is that it is 
hidden from view, and this lessens the risk of vandalism. 

The claim as originally stated: "... whereby said 
mounted enclosure conceals the pin-hole camera to lessen 
the risk of vandalism..." The claim as amended now states: 
"... whereby said plate-mounted assembly conceals said pin- 
holed lens camera to lessen the risk of vandalism..." 

The assembly needs to be placed behind something that is 
thin and inconspicuous , for example, a license plate, with 
a tiny hole drilled through it, so that the pin-holed lens 
of the micro-video camera can see through. 

The plate must be thin so that the field of view of the 
lens is not substantially reduced in size. A wide-angle 
field of view is advantageous while backing. 

Affixing the back of the metal plate directly against the 
metal lens housing creates a problem: In winter conditions 
the coldnesa of the metal plate passes to the metal lens 
housing and then to the interior circuit board, causing the 
camera to become inoperative. In summer conditions, exces- 
sive heat passes through to the interior of the camera. 

Therefore, the clear plastic pane in the applicant's 
assembly insulates , and also protects from moisture, dust, 
and scratches. 


Appn. Number 09/232,566 (Rolf Jansen) GAU 2713 Amnt A 6 


The plastic pane is necessary in order for the assembly to 
be mounted on the back side of the plate in a manner that is 
effective in all weather conditions- 

But the main reason for the plate-mounted assembly is to 
hide the camera from view to lessen the risk of vandalism, 
yet to allow the camera to be positioned low enough to have 
a direct view of a loading platform, or dock. 

A video camera assembly positioned low, at the back of a 
freight trailer, and not hidden from view, is exotic and 
will attract attention. 

In Houston, Texas, for example, many freight trailers are 
parked in lots next to the Houston Ship Channel. This is 
an industrial section of the city. Street gangs of youth 
are common in this area. 

Those conditions are certainly not limited to Houston, 
Texas. Gangs are common in urban, industrial sections. 
Tractor/trailer rigs naturally gravitate to industrial 
sections . 

A video camera assembly positioned low but not hidden 
from view is at risk of being vandalized — damaged or 
stolen . 

The applicant's plate-mounted assembly is a novel improve- 
ment over an assembly that is positioned low but not hidden 
from view. 

2. Unrecognized Problem ; The problem solved by the invention 
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was never before even recognized. The recognition of an 
unrecognized problem militates in favor of patentability. 

Yang does not address the risk of vandalism at all. 

_3* Lack of Implementation : If applicant's plate-mounted 
assembly were in fact obvious, because of its advantages, 
those skilled in the art surely would have implemented it 
by now. That is the fact that those skilled in the art 
have not implemented the applicant's plate-mounted 
assembly/ despite its great advantage, indicates that it 
is not obvious. 

4. As stated earlier in this Response/ the plastic pane is 
is necessary in order for the assembly to be mounted on 
the back side of the plate in a manner that is effective in 
all weather conditions. But it is the plate-mount itself 
that is the heart of the invention (Claim 2). Therefore/ 
the applicant decided to delete mention of the pane in the 
amended claim (Claim 4). 

T herefore / for the reasons stated above/ applicant submits 
that Claim 2 is allowable over the cited reference and 
solicits reconsideration and allowance in its amended form/ 
as Claim 4. 

Conclusion 

For all of the above reasons, applicant submits that the 
claims are now in proper form, and that the claims all define 
patentably over the prior art. Therefore, he submits that 
this application is now in condition for allowance, which 
action he respectfully solicits. 
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Conditional Request For Constructive Assistance 

Applicant has amended the claims of this application so that 
they are proper, definite, and define novel structure which is 
also unobvious. If/ for any reason this application is not 
believed to be in full condition for allowance, applicant 
respectfully requests the constructive assistance and sug- 
gestions of the Examiner pursuant to M . P . E . P . 706 . 03 ( d ) and 
707.07(j) in order that the undersigned can place this appli- 
cation in allowable condition as soon as possible and without 
the need for further proceedings. 


Very respectfully / 

Rolf Jansen/ Applicant Pro Se 
P.O. Box 73161 
Houston, TX 77273-3161 
Tel. 281-440-6907 


Certificate of Mailing : I certify that on the date below 
this document and referenced attachments, if any/ will be 
deposited with the U.S. Postal Service as first class mail 
in an envelope addressed to: "BOX NON-FEE AMENDMENTS/ 
ASSISTANT COMMISSIONER FOR PATENTS, WASHINGTON, DC 20231." 
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[57] /ABSTRACT 

A vanity console is provided with a housing having a mirror 
mounted therein made of a material providing both reflec- 
tivity and transmissivity characteristics. A source of illumi- 
nation such as a peripheral fluorescent tube extends behind 
the outer periphery of the mirror and directs light through the 
two-way mirror for xise of the vanity mirror in bw ambient 
light conditions. The mirror preferably is shaped to conform 
to the shape of a user's face. In one embodiment of the 
invention, positioned centrally behind the mirror is a video 
image source, such as an LCD display, which is supplied 
with video information from a variety of sources such as 
vehicle mounted cameras that the vanity console can serve 
the function of video imaging as well. 

12 Claims, 7 Drawing Sheets 
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VANITY CONSOLE 

BACKGROUND OF THE INVENTION 

Ibc present invention relates to a vanity console for use 
in a vehicle and one which provides an iUumiaated vanity 
minor and/or video imaging. 

Ilium inated vanity mirror visors have been popular for 
many years and are a commonplace vehicle accessory. 
Although the vanity mirror incorporated in a visor is a 
convenient and cost efficient utilization of the visor for 
multiple functions, it does not always provide optimized 
functionality for a vanity mirror which is due, in part, to the 
shape constraints on a mirror mounted to a visor. U.S. Pat. 
Noa 4,824,159 and 5,182,675 disclose vehicle mounted 
vanity mirrors which are shaped to conform more closely to 
the face of a user and which are mounted independently 
from a visor. Such mirrors function only as vanity minors 
and, when illuminatedi the mirror area available, due to the 
placing of lights on either side of the mirror, is somewhat 
limited. 

Iherc remains a need to provide separate functions for 
visors and for illuminated 15 vanity mirrors which optimize 
the functionality of the viewing structure. It is desirable, 
therefore, to provide a mirror which is proportionate to the 
shape of one's face and provide improved lighting. Further, 
it is desirable to provide a vanity console which can be 
located in an area which does not interfere with the operation 
of separate visors nor block the operator's or driver's view 
of the roadway. 

SUMMARY OF THE PRESENT INVENTION 

By providing a vanity console which can be optimally 
located in the vehicle headliner at one or more locations, 
each individual can be provided with an Ulumioated vanity 
mirror which is positioned conveniently for utilization as a 
vanity mirror without interfering with the operation of other 
vehicle accessories, such as overhead consoles, visois, or the 
like. In the preferred embodiment of the invention, a vanity 
console is provided with a housing having a mirror mounted 
therein made of a material providing both reflectivity and 
transmissivity characteristics. The vanity console is coupled 
to a storage housing by a mechanical linkage allowing the 
console housing to be moved from a recessed, stored posi- 
tion within, in the preferred embodiment, the headliner of a 
vehicle to various lowered, adjustable use positions. 

In the preferred embodiment of the invention, the illumi- 
nation means comprise a peripheral fluorescent tube extend- 
ing around and behind the outer periphery of the mirror for 
directing light through the optical coating for use of the 
vanity mirror in low ambient light conditions. The mirror 
preferably is shaped to conform to the shape of a user's face. 
When the mirror is used without illumination, the entire 
surface area of the mirror is available for use and, when the 
illumination is activated, only a relatively small peripheral 
boarder directs illumination toward the user's face thereby 
optimizing the surface area of the mirror usable under both 
low and high ambient light conditions. 

In another embodiment of the invention, positioned cen- 
trally behind the mirror is a video image source, such as an 
LCD display, which is supplied with video information from 
a variety of sources such as vehicle mounted cameras such 
that the vanity console can serve the additional function of 
video imaging. In some embodiments of the invention, the 
video imaging is enhanced vision providing, for example, 
magnification of a portion of the user's face. Alternatively, 
the system may include cameras directed forwardly and/or 
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rearwardly of the vehicle for providing rear visibility for 
parking, internal rear visibility for conversation with rear 
seat passengers or forward visibility utilizing an enhanced 
light amplification camera for providing video images under 

5 low ambient light conditions. 

Thus, the vanity console of the present invention provides 
both an improved vanity mirror for utilization by a vehicle 
operator or passenger and/or video imaging for various 
fimctions when connected to a source of video signals. 

10 These and other features, objects and advantages of the 
present invention will t>ecome apparent upon reading the 
following description thereof together with reference to the 
accompanying ch-awings. 

15 BRIEF DESCRIPTION OF THE DRAWINGS 

FIG. 1 is a fragmentary, perspective view of a vehicle 
including a vanity console embodying the present invention 
with the console shown in a stored position; 

20 FIG. 2 is a fragmentary, perspective view of the console 
of FIG. 1 shown in a lowered use position with behind-the- 
mirror peripheral illumination; 

no. 3 is an enlarged left side, elevational view of the 
vanity console shown in FIG. 2; 

^ FIG. 4 is an enlarged, fragmentary, top rear perspective 
view, partly broken away, of the mechanical coupling of the 
vanity console housing to the storage housing shown also in 
FIGS. 1-3; 

^ FIG. 5 is a cross-sectional view of the vanity console 
taken along section lines V — V of FIG. 3; 

FIG. 6 is a fragmentary, perfective view of a vehicle 
showing an alternative embodiment of the invention; 

FIG. 7 is a fragmentary, perspective view of a vehicle 
35 including yet another embodiment of the invention; 

RG. 8 is a vertical, cross-sectional view through the 
vanity console shown in FIGS. 6 and 7, showing the 
mounting of the video displays behind the partially reflective 
mirror of the vanity console; 
^ FIG. 9 is a pictorial view of a vehicle showing the position 
of mounting of various cameras in a video imaging system 
such as that shown in FIGS. 6-8; and 

FIG. 10 is an electrical circuit diagram in block form 
showing the electrical circuit employed for coupling the 
circuit elements employed in the video imaging system of 
the vanity console of the present invention. 

DETAILED DESCRIPTION OF THE 
PREFERRED EMBODIMENT 

50 

Referring initially to FIGS. 1 and 2, there is shown a 
vanity console 20 embodying the present invention mounted 
in a vehicle 10, such as an automobile, and in particular to 
the roof area above v^dndshield 12 near the junction of the 

55 A-pillar 14 with the windshield and roof. The vanity console 
20 is, in the preferred embodiment, recessed within the 
headliner 16 and is positioned in the embodiment shown in 
FIG. 1 in the upper left front comer of the driver's side of 
the vehicle. The vehicle may include a slide out visor 

60 assembly 18 of the type disclosed in U.S. Pat. No. 5,328, 
277, although a conventional visor assembly can be 
employed with its pivot rod bracket positioned below con- 
sole 20. 

Console 20 comprises a vanity minor housing 22 mov- 
65 ably coupled to a recessed storage housing 24 which may 
include a decorative bezel 26. Housing 22 comprises an 
outer panel 28 forming the outer decorative covering for the 
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housing 22 and an inner frame 30 (FIGS. 2 and 3) for a glass surface 31 to which there is applied a partially reflec- 

vanity mirror 32 mounted, as best seen in RG. 5, between tive and partially transmissive coating 33 to provide partial 

panel 28 and frame 30. Recessed within the surface of panel reflectivity and partial transmissivity for mirror 32. In the 

28 may be a trainable garage door opening transmitter 34 preferred embodiment of the invention, coating 33, which is 

(FIGS. 1 and 5) of the type disclosed in VS. Pat. No. 5 a standard commercially available film which can be 

5,442340. The vanity console 20 provides a convenient vacuum deposited onto the rear surface of glass panel 31, 

location for operation of such a garage door opening trans- bad a reflectivity of from 50 to 90 percent and a transmis- 

mitter which can also be employed for the activation of sivityof from 50 to 10 percent, respectively. The reflectivity. 

interior home lighting utilizing one of the three available in the preferred embodiment, was about 60 percent, while 

channels. A latch assembly with an actuator pad 36 on the the light transmissivity was about 40 percent. The purpose of 

bezel 26 holds the movable console housing 22 within employing the two-way mirror 32 for the vanity console is 

storage housing 24. When actuator pad 36 is depressed by to aUow iUumination means 60 positioned behind the mirror 

the operator, the latch, which caii be of oonvenUonal design, 32 ^nd/or a video monitor, as described in another embodi- 

aUows the vamty console which is coupled to storage ^^^^ ^o be viewable and visible from the front side 

housing 24 by a roechantcal hrJcage, shown in FIGS 3 and ^^^^ ^^^^^ 32 ^ ^ 

4 and desaibed below, to drop down sumcienUy to allow the . ^ ^ • u u n ■ JA 

^. 1 J ji • . 1 . J a standard mirror when such illummation means 60 are not 

user to move the console downwardly mto a selected use , , v *iiv 

position as shown, for example, in FIG. 2 in which the a^^vaii^. 

mirror 32 is exposed for use. * preferred embodiment of the invention as seen in 

As best seen in FIG. 2, vanity housing 22 is somewhat ^ ^» illumination means 60 comprises a peripheral 

oval and generally tearndroppcd or face shaped such that 20 fluorescent tube 62 with a generally drcuUr cross section 

mirror 32 can approximate the proportions of the face of a extending around the periphery of mirror 32 to provide even 

user. Thus, the height "H" of the housing 22, as seen in FIG. illumination for the face of the user. When actuated by light 

2, is sufficiently greater than its width "W." In one switch 64 (FIG, 2), the fluorescent tube 62 provides light 
embodiment, the height "H" of housing 22 was approxi- through the transmissive film 33 to the face of the user for 
mately 7 inches while the width "W" was approximately 25 illuminating the face of the user with the central area of the 
5.75 inches. Although the vanity console 20 as shown in mirror stiU appearing as a mirror to the user. Ruorescent 
FIGS. 1 and 2 is moimted to the upper left front comer of the tube 62 can be any glass tube filled with a suitable fluores- 
vehicle, a similar console can be mounted in other locations, cent gas mixture such as mercury-argon to provide the 
such as the right front comer for the passenger, the center of desired light frequency for utilization as a vanity mirror 
the vehicle if it does not inchide an overhead console with, 3Q light. TUbc 62 is mounted to the frame 30 utilizing suitable 
for example, a compass, or in individual rear seating areas motmting brackets such as brackets 66 (FIG. 5) spaced at 
by mounting such consoles to the vehicle roof in appropriate suitable locations and secured to the inner surface of the 
alignment with rear seats of the vehicle. Thus, a vehicle may periphery of frame 30 to pre)vide the secure mounting of the 
contain a plurality of such vanity consoles for providing light tube 62. In FIG. 2 tube 62 is shown in phantom to 
personalized viewing for each occupant. The details of 35 illustrate that it is substantially invisible behind mirror 32 
construction of the illuminated vanity console 20 are now except when illuminated. 

presented in conjunction with FIGS. 1-5. j^^ power supply for actuating the fluorescent tube 62 

The console housing 22 is pivotally mounted to the can also be suitably mounted within the central open area 68 

storage housing 24 by means of a mechanical linkage of console housing 22 and is coupled to the vehicle's 12-volt 

comprising, in the preferred embodiment as seen in FIGS. 40 electrical system through the actuating switch 64 which is 

2-5, a curved arm 38 having a lower end 39 coupled to coupled to the vehicle's operating system through a suitable 

housing 22 by a ball joint assembly 40 (FIG. 5) of conven- power conductor included in the bundle of electrical con- 

lional construction to allow the housing 22 to be adjustably ductors 60. The mirror 32 is commercially available from a 

pivoted about end 39 of arm 38. The opposite end 42 (FIG. variety of commercial suppliers, such as Libbey Owens 

4) of arm 38 extends through a slot 44 in the rear wall 45 of 45 Ford, and can be manufactured with the desired light 

storage housing 24, as best seen in FIG. 4, and is coupled to transmissive/ reflective characteristics for a given installa- 

a transversely extending pivot rod 46 which is mounted to a tion. Similarly, illumination means 60, although in the 

split flange 48 extending from the periphery of housing 24. preferred embodiment comprises a fluorescent tube, may 

In the preferred embodiment, flange 48 is bifurcated and take on other forms of illumination such as conventional 

includes semicylindrical sockets 50, 52 for receiving the 50 lamps. It has been discovered, however, that the peripheral 

pivot rod 46 which is captively held to the bifiircated flange boundary lighting provided by the continuous fluorescent 

48 by means of keeper plates 51, 53 secured to flange 48 by tube 62 is preferable. 

suitable fasteners such as nut and boll combinations 54. The [□ addition to providing the iUuminated vanity mirror with 

hollow pivot arm 38 allows a plurality of electrical conduc- concealed illumination to allow the full surface of the mirror 

tors 60 to extend from within the console housing 22 to the 55 to be used under normal ambient lighting and an illuminated 

vehicle's electrical system for providing operating power mirror to be used under low ambient Ughting, the console 20 

and video signals for the video imaging system of the of the present invention can also provide video imaging as 

present invention. illustrated in the embodiments shown in RGS. 7-10. In such 

Housing 24 is mounted to the sheet metal roof of a vehicle embodiments, a video monitor is incorporated in the space 

usingsuitable mounting brackets 56 which extend outwardly 60 68 (RG. 5) of the illuminated vanity console 22 which 

from the periphery of the housing 24, as ilhistralcd in FIG. provides the same iUuminated or non -illuminated vanity 

3, at various locations to secure the housing either directly mirror functions as before with the addition of the capability 
to the sheet metal roof of the vehicle or to a reinforced area of video imaging behind the light U-ansmissive mirror 32 
of the headiiner 16 if console 20 is pre-mounted to the when desired. The video imaging is now described in 
headliner as a preformed assembly. 65 connection first with the display functions provided in FIGS. 

The mirror 32 of the preferred embodiment is, as best seen 6 and 7 and subsequently the description accompanying 

in FIG. 5, a two-way type mirror which includes an outer FIGS. 8-10. 
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Referring to FIG. 6, there is shown a vanity cxinsole 120 
which is of the same construction as vanity console 20 with 
similarly identified components including the numerical 
prefix "1." Console 120 additionally includes of video 
monitor 90, video source selector switches 70, 72, 74 and 5 
zoom control switch 76, which switches are mounted to the 
lower end of housing 130. As seen in FIGS. 6 and 8, 
positioned centrally behind the minor 132 is a flat screen 
video monitor 90 having a video image projecting surface 92 
immediately adjacent film 133 such that images projected by 
motiitor 90 can be seen through mirror D2 as seen in FIG. 

6. A first television camera 94 has a zoom lens 95 controlled 
by zoom control switch 76 and is pointed toward the user's 
face. Camera 94 is activated by switch 70 which also 
couples its composite video output signals to the input of 
monitor 90. Camera 94 thus can provide an enhanced 
close-up and magnified image, shown as the lip area 21 of 
the user 23 in FIG. 6, such that such a magnified image can 
be viewed through the vanity console 120. With such 
system, it may be desirable to actuate the illim:iination means 20 
160 to provide sufficient light for camera 94 to provide a 
clear magnified image of a portion of the user's face. 
Camera 94 can be a conventional color CCD type camera 
with a controllable zoom lens 95 to also provide a wide 
angle field of view such that the user can view rear seat ^5 
passengers either for conversational purposes or for tending 

to infants or yoimg children. Thus, camera 94 typically will 
be mourned in an area proximate the user 23 but also facing 
generally rearwaidly such that it can provide a clear line of 
vision to both the face of the user as well as the rear seat area 
of the vehicle. Video monitor 90 can be a conventional flat 
screen color LCD type monitor, preferably having a diago- 
nal screen of approximately 3 to 4 inches and which receives 
composite N.T.S.C. video signals from one of a plurality of 
cameras such as camera 94. 35 

In the embodiment shown in FIG. 7, the vanity console 
120 includes not only a video monitor 90 but, in addition, a 
distance display 91 which operates in conjunction with an 
ultrasonic or infrared distance measuring sensor 97 associ- 
ated with a rear vision camera 96 (FIG. 9). Camera 96 is 40 
mounted in the rear area of the vehicle, preferably in the rear 
bumper area behind a suitable sealed window for providing 
protection for the camera from the environment. A video and 
power supply conductor 96' extends from camera 96 as 
described in connection with FIG. 10 to provide composite 45 
color video signals to the monitor 90 mounted within the 
body of console housing 122. Camera 96 can provide a wide 
angle rear view of traflSc or objects behind the vehicle. 

As seen in FIG. 7, a video image 25 from camera 96 is 
displayed by monitor 90 showing the proximity of, for 50 
example, a lamp post 27 as being 2.5 meters from the rear 
bumper area as indicated on display 91 positioned above the 
monitor display surface 92. The distance measuring 
(D.M.E.) system 97 is a commercially available unit which 
provides digital signals from a sensor unit representing the 55 
distance of an object from the sensor. Such signals are 
coupled to an LED display 91 for display. Such D.M.E. units 
are generally commercially available. 

In addition to cameras 94 and 96 as shown in FIGS. 6 and 

7, as seen in FIG. 9, a vehicle 10, such as an automobile may 60 
also include a forward facing camera 98 which can be 
employed for selectively providing a wide angle view of the 
roadway. Camera 98 may be coupled, if desired, to a video 
tape recorder as well as to monitor 90 for providing a record 
of areas traveled by, for example, a family on vacation. 65 
Thus, in addition to providing froot visibility, camera 98 can 
be used as a video signal source for recording scenery. If 


desired for use under low ambient light conditions, camera 
98 can be of the type including image enhancing sensors 
such as are commercially available from IT&T to provide 
low light enhanced visibility under poor lighting conditions 
to provide a visual aid to the vehicle operator under such 
conditions. It is to be understood, however, that such 
enhanced light imaging is used as a further assistance to the 
vehicle operator and not as the primary field of vision for the 
vehicle operator. Each of the cameras 94, 96 and 98 can be 
adjustably mounted to the vehicle to allow the vehicle 
operator to adjust the pointing direction for particular appli- 
cations. Such adjustable camera mounts are conventional. 

Turning now to FIG. 10, there is shown a block electrical 
circuit diagram of the system in which each of the cameras 
94, 96, 98 are coupled by a video select control circuit 78 
including switches 70, 72, 74 for providing a video output 
signal by a conductor 71 to the video input of monitor 90. 
Input from camera 96 is applied to video select console 78 
through video conductor 96*. Similarly, cameras 94, 98 are 
coupled via conductors 94*, 98' to the input of video selector 
circuit 78 such that any one of the camera's composite video 
output signals can be selected for display on monitor 90. 
Similarly, display 91 is coupled to the distance measuring 
sensor 97 by means of conductors 97' to provide signals 
applied to display 91. Zoom control switch 76 is a conven- 
tional spring loaded two-position switch coupled to camera 
94 by means of a pair of conductors 77 to provide zoom in 
and zoom out control signals for the camera lens 95. In some 
installations, it may be desirable to also provide cameras 96 
and 98 with zoom lenses, in which case the video select 
switch console 78 may also include conventional circuits for 
coupling zoom control 76 to the particular camera selected. 
Suitable operating power from a vehicle's power source 100 
is selectively applied to the cameras by the actuation of the 
selector switches 70, 72, 74. Such power can be applied 
through conductors 94', 96', 98' if desired to minimize the 
required wiring. In the embodiment shown in RGS. 1-5 and 
6-10, when the video raonilor 90 is not activated by the 
actuation of one of the switches 70, 72, 74 a first time (a 
second depression deactivating the camera and also power to 
display 90), the mirror 132 can be utilized with or without 
the back lighted illumination means 160 to provide a vanity 
mirror for normal use. As with the vanity console 20, 
consoles 120 can be positioned at various locations within 
the vehicle and may include additional switch circuits so that 
each monitor can be coupled to a selected camera or other 
video source. 

These and other modifications to the preferred embodi- 
ments of the invention described herein can be made by 
those skilled in the art without departing from the spirit or 
scope of the invention as defined by the appended claims. 

The embodiments of the invention in which an exclusive 
property or privilege is claimed are defined as follows: 

1. A vanity minor console for a vehicle comprising: 

a housing; 

a partially reflective two-way mirror mounted to said 
housing; 

a video camera mounted to the vehicle for providing a 
video image; and 

a video display mounted in said housing behind said 
two-way minor for providing a video image through 
said mirror to be visible to a user facing said mirror, 
wherein said camera has a lens positioned to face the 
user of said vanity mirror console and an electrical 
circuit coupling video signals from said camera to said 
video display for providing a video image of the user's 
face. 
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2. The vanity console as defined in claim 1 wherein said 
lens is a zoom lens and said housing includes a control for 
operating said zoom lens. 

3. The console as defined in claim 1 and fiirther including 

a source of illumination positioned in said bousing behind 5 
said mirror and visible when actuated for projectiag light 
outwardly through a first portion of said mirror to provide 
illumination to the face of a user. 

4. The console as defined in claim 3 wherein said partially 
refiective mirror has a reflectivity from about 50% to 90% lo 
and a corresponding light traosmissivity from about 50% to 
10%. 

5. The console as defined in claim 4 wherein said reflec- 
tivity is preferably about 60% and said transmissivity is 
about 40%. 15 

6. A vanity mirror console for a vehicle comprising: 
a housing mounted in the vehicle; 

a partially reflective vanity mirror mounted to said hous- 
ing; 

a video display mounted in said bousing behind said 
mirror for providing a video image through said mirror 
to be visible to a user, and 

a plurahty of video cameras for mounting to a vehicle, 
wherein a first of said cameras has a lens facing the user 25 
of said video console and a circuit selectively coupling 
video signals from said first camera to said video 
display for providing a video display of the user's face 
on said video display. 

7. The vanity console as defined in claim 6 wherein said 30 
lens is a zoom lens and said housing includes a control for 
operating said zoom lens. 

8. The console as defined in claim 6 wherein a second 
camera is mounted to the vehicle with a lens facing rear- 
wardly to view objects outside and behind the vehicle, and 


20 


further including a circuit for selectively coupling said first 
or said second camera to said video display. 

9. The console as defined in claim 8 and fiirtber inchiding 
a third camera for mounting to a vehicle in a forward facing 
direction for viewing the area in front of the vehicle and 
wherein said circuit selectively couples at least one of said 
first, second or third cameras to said video display. 

10. The console as defined in claim 6 wherein said 
partially reflective mirror has a reflectivity from about 50% 
to 90% and a corresponding light transmissivity from about 
50% to 10%. 

11. The console as defined in claim 10 wherein said 
reflectivity is preferably about 60% and said transmissivity 
is about 40%. 

12. A vanity mirror console for a vehicle comprising: 
a housing; 

a partially reflective mirror mounted to said housing; 

a source of illumination mounted in said housing behind 
said mirror and only visible when actuated for directing 
illumination outwardly from said source through a 
portion of said partially reflective mirror to provide 
illumination to the face of a user; 

an electrical circuit including a switch for selectively 
actuating said source of illumination; 

a video display mounted in said housing behind said 
mirror for providing a video image visible through said 
mirror when actuated; and 

at least one video camera for mounting to a vehicle and a 
circuit selectively coupling video signals from said at 
least one camera to said video display for providing 
video signals for display, wherein said at least one 
video camera has a lens facing a user of said video 
console for providing a video display of the user's face. 


M.k ^illMMii.i„.ui_Liii_.. 



ofverflowing with all the icons, web pages, and 
digital photographs we've crammed onto 
them, haven't fared much better. Plain and 
simple, computer users need more real 
estate— K)n both their screens and their desks. 

A remedy for both shortages exists in the 
form of a 21 -inch flat-panel monitor made 
from a thin liquid-crystal display (LCD) 
similar to those used in laptops. But a flat- 
panel that large comes with a price tag in the 
thousands. What are realistic options if your 
budget is in the hundreds? 

If a larger screen is a must, a 19- inch 
cathode ray tube (CRT) monitor may be the 
answer. Prices have feUen so much in the 
past couple of years that you can find plen- 
ty of these in the $300 to $600 range. If desk 
space is your priority, a space-saving 15- 
inch flat-panel can now be had for as little as 
$600. While costlier than most 19-inch 
CRTs, that's stiD 30 percent cheaper than 
those flat-panels were last year, the result of 
an increased supply. 

To help you choose among the monitors 
most people buy, we tested five 15-inch flat- 
panel LCDs, nine 17-inch CRTs (the type 
that's usually bought with a new computer 
or as a replacement for an aging monitor), 
and seven 19-inch CRTs. All 21 models 


work with an analog computer video card 
and are compatible with a Windows-based 
PC or a Macintosh. The exception is the 
Apple Studio Display, which is strictly for 
PowerPC G4-based Macs. Four very good 
CRTs tested for last June's report are still 
available, and they are noted in the Ratings. 

SIZING THEM UP 

The CRT size displayed in an ad is generally 
not the size of the image you see, but the 
nominal size of the entire tube, including 


the part that's not visible. Advertisers 
quote the nominal size, v^ch makes 
monitors seem larger. Look instead for the 
viewable-image size (VIS), which is the 
diagonal measurement of the image you*U 
see. It's typically about an inch smaller than 
the nominal size. As a result of a class-action 
suit, ads must disclose a CRT's VIS; but to 
find it, you may have to ch^ the fine print 
A flat-panel's VIS is the same as its nominal 
size, making a 15-inch flat-panel nearly the 
equal of a 17-inch CRT. (The CRT provides 
only 14 percent more viewable area.) 

CRT: Footprint vs. image size. Footprint 
is the area a monitor occupies on your desk- 
top. It's an issue only for a CRT, whose girth 
increases with larger screen size. To estimate 
whether a CRT will fit in your particular 
space,, figure on a footprint as deep and 
wide as the monitor's nominal screen size. A 
larger screen lets you view several files 
simultaneously or see more of one file — 
more lines of text in a letter, say, with the 
characters large enough to be read easily. 
For example, a 19-inch CRT provides about 
25 percent more space for images and words 
than a 17-inch one, but the larger CRT has 
a footprint about 19 inches deep. A few so- 
called short-depth 19-inch CRTs, such as 
the Gateway VX920, the IBM G96, and the 
Hitachi CM77U are an inch or two shallow- 
er than the rest, but they are still bulky. 

There's no trade-off" to make between a 
flat-panel's screen size and footprint Even 
the largest flat-panels have footprints just a 
few inches deep, much smaller than a 
CRT's. (Don't confuse a flat-panel display 
with a flat-screen monitor, which is a CRT 
with its face flattened to reduce glare and 
reflections.) 


Fiat-panel vs. CRT monitor 
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CLOSE-UP Pixels on flat-panel Cabova left) and CRT. 



ATffORHAl VIEWII» DtSTANCEThe only obvious 
difference is the CRTs lower contrast Cabove^ right). 
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Final arrangements 

As an estate-planning and elder-law 
attorney, I agree with yo ur conclu- 
sion that prepaying a 
funeral may not be the 
best use of money in 
most cases. There is one 
situatioii where it should 
be considered, however. 
If a person has to quali- 
fy for Medicaid, the 
general rule is that assets must be reduced 
down to $2,000 for a single person. 

One standard reconunendation is to 
prepay funeral and burial expenses. That 
hastens the spend-down and achieves 
Medicaid eligibility that much sooner. 
Then, upon the elder person's death, the 
family will not have to dig into its pockets 
to pay funeral bills. 

K. Gabricl Heiser Brentwood. Tenn. 

Your May report on prepaid funerals 
brought back some very painful 
memories. My mother paid $1 1 1 a month 
out of her $400 Social Security check for a 
prepaid funeral plan to spare my brother 
and me the expense and anxiety of dealing 
with funeral arrangements. When she 
died she had paid only $4,63 1 for the plan. 
The funeral cost $7,617, administrative 
fees were $541, and cemetery charges 
amounted to another $1,306. This prepaid 
funeral cost my brother and me $4,833. 

I tell everyone who's considering a pre- 
paid fimeral plan to put the money in the 
bank and Ust a beneficiary, just as you rec- 
ommended. These pre-need plans are 
truly unneeded. 

Michael Luster Kansas City. Mo. 


A prepaid funeral worked for our fam- 
ily. My father, v^o died in 1976, didn't 
have a prepaid funeral. Dealing with the 
arrangements was an emotional night- 
mare. After my mother remarried, 1 per- 
suaded her and my stepfather to make 
arrangements in advance. My folks chose 
exactly what they wanted. Perhaps living 
in a small town helped. The salesman was 
a longtime acquaintance. When my step- 
father died three years later, we were able 
to take care of the funeral without undue 
duress. Not having to "deal" in a rush of 
time and emotions was a blessing. 

Marilyn Lynch Elk Citv, Okla. 

Safety Assessment update 

The safety reports in the April auto 
issue noted that the Nissan Xterra 
sport-utility vehicle tipped over during 
the government's side-impact crash tests. 
Unfortunately, you did not have access to 
critical information regarding that test: A 
high-speed tow cable interfered with one 
of the Xterra's tires, effectively tripping the 
vehicle and causing it to tip. Three other 
side-impact tests that did not involve 
cable interference resulted in no rollover 
of the Xterr<L The government has 
acknowledged the problems with its test. 
It is misleading to say that the Xterra 
rolled over without also noting that the 
test was abnormal. 

Debra Sanchez Fair 
Vice President. Corporate Communications 
Nissan North America Inc.. Gardena, Calif. 
The NaHonal Highway Traffic Safety Adminis- 
tration (NHTSA) says it doesn't know whether 
the Xterra rolled over solely because of the side- 
impact crash or because of the crash and cable 


interference. However, the rollover has no bear- 
ing in terms of gauging performance in that 
test, NHTSA does not factor rollovers into its 
side-impact score. Con^uently, the roUover 
did not affect the CR Safety Assessment ranking 
for the Xterra. It ranked third among small 
SUVs, after the Mercedes-Benz ML430 and 
Jeep Grand Cherokee. 

Cause and effect 

It made my heart sing to read the May 
"Your Health" column about the health 
effects of coffee. Nearly all journalists 
would have assimied from the perceived 
effect of coffee on miscarriage that it was 
an obvious cause-and-effect relationship. 
Your writer didn't make that assumption, 
instead making the following statement: 
"You're never sure whether drinking 
coffee increases the risk of a miscarriage 
or whether many women who have a 
normal, healthy pregnancy just lose their 
taste for coffee." Bravo for understanding 
the difference between relationships and 
direct causality. 

Susan Bocart Los Gatos. Calif. 

Digital divides 

I was appaUed by the May letter to the 
editor from Richard Nolan, criticizing 
your call for subsidies to help low-income 
people gain Internet access. An enlight- 
ened public realizes that our society bene- 
fits when every citizen has a realistic 
chance at a productive life and the oppor- 
tunity to fulfill his or her potential. In the 
digital age, fulfilling that potential requires 
equal access to technology. 

Mary Landolfi West Orange. N J. 
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video camera having an image sharpness control, which can 
follow an object once detected, in tenns of its sharpness, 
with the camera's autofocus over die whole search field, for 
example, by using fuzzy logic The device uses this property 
for an image-processing-suHxated tracking of the viewing 
angle of a video camera which is designed to be pivotable 
and is used for rear-space or front-space monit<»ing, by 
which an object limiting the rearward or forward penetration 
depth of the vehicle can be seen up until contact with the 
vehicle's bumper: The device eliminates obstacles which 
previously prevented die use of such video cameras in the 
rear space monitoring of private cars. A conesponding 
device can also be provided and used for monitoring the 
front space of a vehicle. 
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SYSTEM FOR MONITORING THE FRONT 
OR REAR PARKING SPACE OF A MOTOR 
VEHICLE 

BACKGROUND AND SUMMARY OF THE 
INVENTION 

TTie invention relates to a system for monitoring the front 
or rear parking space of a motor vehicle and, more 
particularly, to a system having a video camera built into 
either the front or rear of the vehicle and a viewing and 
monitoring device in the field of view of the vehicle driver 
connected to the camera. The field of view is fitted with a 
display screen. 

Approach problems during the parking of vehicles, such 
as avoiding other vehicles, walls and the like, are well 
known. Known active systems which attenq)t to alleviate the 
approach problems, such as those having infrared light 
and/os* ultrasonic sensors, suffer from a lack of measurement 
accuracy, reliability and reproducibility. 

One alternative is represented by rear space video 
cameras, whose use in the area of commercial vdiicles, such 
as airport courtesy vehicles, is already known. While the use 
of such video cameras, specifically in private cars, would be 
desirable due to the fact that parking spaces are becoming 
ever tighter, often requiring driving accuracy to within 
centimeters, the increasingly obscure rear parts of vehicles 
make this more difiBcult The rear geometry of normal 
private cars, however, makes extremely wide angle lenses 
necessary. Unfortunately, such wide an^e lenses provide the 
vehicle driver with an image which can hardly be inter- 
preted. 

There is therefore needed a system for monitoring the 
front or rear parking space of a motor vehicle which delivers 
to the vehicle driver a clear and easily inteipretable display 
<rf the vehicle front or rear space and its boundary edges ot 
obstacles. 

These needs are met according the present invention by a 
system having a video camera built into either the front or 
rear of the veiicle and a viewing and monit<aing device in 
the field of view of the vducle driver connected to the 
camera. The field of view is fitted with a display screen. The 
video camera is equipped with means for its pivoting (turn 
and tilt) as a function of electric drive signals and is of the 
type having object referenced image sharpness control of its 
optics. This sharpness control is effective over the whole 
image angle drtected, so that a corresponding sharpness 
measuring field is capable of following an . object once 
detected over the whole screen. The system further includes 
an image processing unit which subdivides the image picked 
up into fields or quadrants and/or an edge region outside and 
a central region inside an auxiliary frame. The image pro- 
cessing unit is aqpable of discerning the instantaneous 
position of the sharpness measuring field with reference to 
at least one of the fields or quadrants and/or to the auxiliary 
frame and, as a function of a tendency of the sharpness 
measuring field to leave the original fidd/quadrant, not to 
reach a predetermined field or predetermined quadrant and/ 
or to cross &om the central region over the auxiliary frame 
out into the edge region of the image field. The image 
processing unit generates the above-mentioned drive signals 
for the pivoting means according to the measure that the 
pivoting of the camera thereby effected counteracts Ae 
triggering tendency or neutralizes or eliminates the trigger- 
ing tendency. 

The present invention makes use of the fact that modem 
video cameras, which increasingly are controlled by "fiizzy 
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logic", can follow an object once detected, in tcnns of its 
sharpness, with the autofocus (AF) over the whole search 
field Off over the whole image angle, by ^^ch means fee 
distance measuring field or sharpness measuring field moves 
5 along with the object, that is to say, in the case of its 
approadi or removal is virtually dragged with it In this 
respect, tiie sharpness adjustment is no longer seardi-field- 
referenced bat object referenced. 
According to the present invention, this property is used 
jQ for an electronic tracking of the viewing an^ of such a 
video camera used for rear-space or front-space nK)nitDring. 
Because of this, an object limiting the rearward or forward 
penetration depth of the vehicle can be seen up until contact, 
for exan^le, with the buiiq)er and the remaining distance up 
until its disappearance can be seen or easily judged. 

In feis case, as a whole, the device according to &e 
invention exhibits the advantage that camera lenses of very 
compact construction can be used, without the requirement 
of extending the camera for the purposes of realizing a 
20 sufficient viewing angle. The assembly of the camera is thus 
possible within the vehicle contour. The image intopretation 
is simplified for the driver by the concentration of the image 
section on the essential obstacle, and complicated image 
processing and image preparation, as are unavoidable in the 
25 case of extreme wide angle optics, can be eliminated. 

Accordingly, a "passive** system having an object- 
referenced guided video camera can be suppcHted at least by 
means of an additional "active** system, for exanq)le an 
ultrasonic or infrared or laser system. Such an additional 
30 system either acts redundantly in situations in which the 
passive system is subject to functional limitations. 
Alternatively, signals from at least one such additional 
system support the active detection of obstacles on die 
camera side, for example in the case of rear space monitor- 
35 ing- 

The use of an additional active system proves 
advantageous, for example in the case of obstacles having a 
low structure, in whidi autofocus control of a video camera 
via fiizzy logic can also fail or, on its own, delivers too large 
40 a decision time delay. 

Differing from conventional active ultrasonic or light 
measuring systems, at least one additional system of this 
type can ^erefore be primarily used here not f<K' warning or 
giving alarms, but for influencing or supporting the capture 
45 and object following behaviw of the electronic autofocus 
function of a video camera. By means of connecting the 
passive system to at least one of the above-mentioned active 
systems in a device, die respective weaknesses of the 
relevant individual systems are thus overcome in any case. 
50 As a whole, the present invention clears essential 
obstacles which previously stood in the way of the use of 
video cameras, especially in the rear space monitoring of 
private cars. It is self-evident, that the possibilities of use of 
the device according to the invention are not limited to the 
55 rear space of a vehicle; a corresponding device can none- 
theless also be provided and used for monitoring the front 
space of a vehicle. 

Other objects, advantages and novel features of the 
present invention will become apparent from ttie following 
^ detailed description of the invention when considered in 
conjunction wi^ flie accompanying drawings. 

BRIEF DESCRIFnON OF THE DRAWINGS 
FIG. 1 is a schematic side view of the system of the 
65 present invention which is provided in a vehicle, as well as 
two exaii^>les of relevant obstacles in the case of rearward 
parking; 
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FIG. 2 is a sdiematic top view of the system, including at 
least one active system and corresponding sensors, built into 
a vehicle, as well as two examples of relevant obstacles in 
the case of rearward paildng; and 

FIGS. 3fl, ^ illustrate two schematic representations of 
two situation displays displayed to die vehicle driver on a 
display screen during reversing, these displays correspond to 
a larger distance "a" and a smaller distance "b" of tiie 
bumper from the nearest obstacle. 

DETAILED DESCRIPnON OF THE DRAWINGS 

According to FIG. 1, the system according to the inven- 
tion includes, for example, a video camera 11 built into the 
rear 12 of a vehicle 10. The following description is given 
by way of example for a rear space viewing system, and it 
is readily understood that a similar system could be used at 
the front of Ae vehicle. The camera 11 is fitted with an 
antofocus measuring system and is connected via a connect- 
ing lead 14 to a viewing and monitoring device 15 located 
in a visual range of tiie vehide driver. In this case, the 
camera U can be pivoted (that is to say tilted and turned) 
under electronic control, by means not shown in the figure, 
through the angle 5 shown in the top view accOTding to FIG. 
2. The viewing and monitoring device 15 has a screen 15.1 
for the driver-side display of the current camera image or 
field of view. 

Also shown is the bumper 13 and, moreover, a distant 
obstacle 16 or l€ designated by "T" and a near obstacle 
designated by **N". The near obstacle "N" is identified by 17 
in the condition A of an even larger distance "a" from the 
rear end or buropcr 13 of the vehicle 10 and identified by IT 
in the condition B of a smaller distance from the rear end 
GT bumper 13 of the vehicle 10. The identifications 16 and 
16' correspond, in a similar maruer, to the two conditions A 
and B. Furthermore, the bounding beams 20.A and 20 JB of 
the respective viewing angle a of the camera U in the two 
(stationary) conditions A and B are shown. 

FIG. 2 shows the configuration according to FIG. 1 in a 
top view. Proceeding from the elements known from FIG. 1, 
the image angle a, the scan angle p, the pivoting angle 
^{p-a}, and additional sensors 21.1 and 21.2 in the two 
end regions of the bumper 13 of at least one active ultrasonic 
or light-based measuring system are also shown here. The 
signal processing or signal evaluation of the system can be 
accommodated in a special module 22, in which the elec- 
tronics necessary for driving the pivoting device on the 
camera side can also be accommodated Such a module 22 
can be connected directly to the camera or to the viewing 
and monitoring device 15 or can also be connected to both 
by means of a connection with the lead 14. Also apparent 
here are the bounding beams 20. A and 20.B of the respective 
viewing angles of the camera 11 in the two (stationary) 
conditions A and B. 

In FIG. 3fl, an auxiliary frame 18 with, for example, field 
or quadrant division 18.1 can be seen on the screen 15.1. 
Furthermore, the objects 16 and 17 are displayed, as seen by 
the camera in the condition A, that is to say in the case of an 
even greater distance "a" of the bumper 13 from the near 
object 17. 

In this case, therefore, both objects 16 and 17 are still 
within the image angle of the camera 11 symbolized by the 
bounding beams 20JV. Moreover, the object 17 situated 
closer is within the current sharpness measuring field 19. and 
is therefore the image content part currently controlling the 
image sharpness and, in this respect, dragging tfie measuring 
field 19 with it It is shown that, in the condition A, tfie 
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camera 11 essentially still detects the whole rear space and 
thus all obstacles with which the vehicle could collide. 

Tlie display on the screen 15.1 according to FIG. 3b 
corresponds to the condition B in the case of an already 
5 considerably reduced distance "b" of the bumper 13 from 
the object simated closer, whidi is here identified by IT 
corresponding to FIGS. 1 and 2. In this case, the field of 
view corresponds to the image field angle between the 
bounding beams 203 in FIGS. 1 and 2. 
10 While the object IT is fecrefore still in the dragged 
measuring field 19 in the central region 15.Z of the saeen 
15.1. the distant object 16— not dominant in the central 
region 15.Z even in ttie condition A, that is to say even at a 
greater distance "a"— has disappeared from the original field 
15 or quadrant 18.1, over the auxiliary frame 18 and the edge 
region 15JI of the screen, from the field of view of the 
camera 11 (already intermediately pivoted). As a result of 
the pivt^g of tiie camera ll--instead of the distant object 
16, a portion of the rear contour of the vehicle, specifically 
20 the bun^ 13, is moved into the field of view ^G. 3fr). 
By means of the insight which has thus become possible 
of the ever decreasing distance b, tiie vehicle can thus be 
driven accurately to within centimeters, for example, until 
the bumper 13 makes contact with the near object IT. It is 
^ understandable that in so doing, the image angle of die 
camera does not have to be significantiy altered, so that no 
complicated, long or expensive lens is necessary. 

Not further shown in the figure is an image processing 
unit which can be realized in any arbitrary manner, and 
^ which can be accommodated or implemented either com- 
pletely in the camera 11, completely in the viewing and 
monitoring device 15, distributed over the camera 11 and the 
viewing and monitoring device 15, or else accommodated or 
in^lemented mainly inside the measuring imit 22. 

It is only essential f<x the invention that the image 
processing unit, as a component of the device, is capable of 
detecting a movement of the object-referenced sharpness 
measuring field 19 in the image plane and to evaluate it into 
^ at least one pivoting signal which when fed as a drive signal 
to the means for pivoting the camera — effects a pivoting of 
the camera in such a maimer that the sharpness measuring 
field 19 optionally does not leave an original detection 
quadrant, reaches and fills at least one predetermined detec- 
45 tion quadrant and/or-^ far as possible — does not wander 
from die central region of the image field over the auxiliary 
frame 18 out into the edge region of the image field, diat is 
to say out of the viewing ang^e of the camera. 
TTie image-processing-supported cooperation of the cam- 
50 era 11 widi the viewing and monitoring device 15 optionally 
also as a fimction of signals which are emitted by additional 
distance-detecting sensors 21.1 and 21.2 on at least one 
additional sonic or ligjit-based measuring system 22, as 
described further below, is as follows. 
55 Upon reaching a critical distance to an obstacle, the image 
processing unit seeks the nearest obstacle 17 for a further 
approach. In tiiis respect, the "critical** distance is deter- 
mined by means of a scan cyde while pivoting the camera 
through the pivoting angle &KP-a) [where p=scan angle, 
60 cc^image angle], initially in the complete detection range of 
the camera (image fidd+pivot). Once detected, the autofo- 
cus measuring system of the camera 11 adjusts its optics to 
the corresponding nearest obstacle 17. 
From this point in time, tiie near obstacle 17 is dominant, 
65 that is to say, the autofocus control of the camera, in 
conjunction with the above-mentioned image processing 
unit, effects the dragging along of die sharpness measuring 
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field 19 wbidx is incident on the dominant object, indepen- 
dently of further relative movements between camera 11 and 
near obstacle 17. The image processing unit thus ensures as 
a whole, not only &at the shaipness range concsponding to 
the distance or movement of the vehicle relative to the near 
obstacle 17, IT in its spatial depth is displaced with refer- 
ence to a contour identified once in the nacasuring field 19, 
but also that the camera is additionally pivoted in such a 
manner that the sharpness measuiing field 19, independently 
of its possibly also wandering position on the screen, cannot 
disappear out over its edge, and also inasmudi as the 
obstacle of interest cannot disappear from the field of view 
of the vehicle driver: 

During this dragging process, the correspondingly chan^ 
ing distance "a", "b" between the banspa 13 and the near 
obstacle 17, 17 can be continuously measured by suitable 
means and can be overlaid on the screoi 15.1. For this 
purpose, sound and/or Hght measuring means, separate, or as 
additional means already mentioned as included in the 
system^ are suitable. 

For high measuring accuracy and a comfortable imagin g 
size of obstacles occurring in practice and an ability to easily 
judge the displayed distance relations, a camera lens not 
having too short of a focal length has proved to be expedient 
Because the image angle achievable with one such lens is 
not sufficient, for exanq)le also to include in the image the 
entire vehicle rear from a base position of the camera 11, the 
image processing unit ensures that if, in the case of further 
approach, the near object IT wanders to the image field edge 
and threatens to disaj^ear from tiie displayed field of view, 
the camera is re-pivoted in such a manner that the near 
object can leave the reproduced field of view of the camera 
only because the field of view is limited by the rear or front 
contour of the vehicle. 

The image displayed to the vehicle driver on tiie screen 
15.1 therefore finally shows the obstacle at the absolutely 
smallest possible distance "b" measured in the longimdinal 
direction of the vehicle, always in relation to the vehicle 
contour appearing somewhere on the edge of the screen, as 
shown, for exanaple in FIG. 3fe in relation to the bun^)er 13. 

If, for exan^le, during a rearward approach of the vehide 
10, the obstacle 16 or IT should move out of the field of 
view of file camera 11 (specifically, past the vehicle towards 
the front), it is detected as not colHsion-dangerous, and the 
image processing unit searches for the next obstacle to be 
considered by means of a new scan process. 

However, although an obstacle present is detected as 
critical and followed, it can occur that, in the meantime, an 
even nearer and even more relevant obstacle appears. The 
more relevant obstacle would then not be detectable because 
of a lack of sharp imaging capability (outside the measuring 
field 19 dragged by the obstacle already present). 

In order to prevent this from occurring, the scan process 
mentioned above is repeated at minimum time intervals, 
specifically at such a rate that the vehicle driver is not 
disturbed during driving up to the obstacle. In this case, it is 
only essential that the vehicle driver is definitely presented 
with the inqxjrtant obstacle to him corresponding to the 
direction of driving of the vehicle. 

Also lying within the scope of the present invention is that 
the system, instead of or additionally to means for triggering 
and effecting the said scan process, also includes another 
independent unit 22 for the detection of the respective 
nearest obstacle. In this case it can be, for example, a lasa 
scanner with a moving beam or a system based on CCD 
inmge detection elements as sensors 21.1 and 21.2 In any 
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case, these can be connected at least to the viewing and 
monitoring device 15 on the driver's side, so that detection 
results of such additional scanning devices can also be 
displayed on the screen 15.1 of the viewing and monitoring 
5 device 15, for example also inserted into the continuous 
image transmission. 

It is also within the scope of the invention that the 
additional devices are operatively connected to the image 
processing unit in such a way, and the latter is designed in 
such a way, that it can derive data about tiie relevant position 
of an obstacle ia the image field of the detection space of the 
additional devices, and can transmit them, at least for the 
pivoting pre-adjusunent of the video camera for the purpose 
of immediate centering of its shaipness measuring field, to 
the pivoting means of the camera, in order to thus achieve 
the most rapidly possible sharp imaging of the critical 
obstacle. 

According to the present invention, such an additional 
module continuously monitoi^ the whole space behind or in 
front of a correspondingly equqiped vdiicle, in order to thus 
20 continuously detect obstacles occurring. For this purpose, 
the additional module has means which, for the purpose of 
the pivoting adjustment of the camera 11 in fiie event of the 
(wide angle) detection of a relevant obstade, can transmit its 
position within the total field of view of the independent 
^ detection unit to the viewing and monitoring device 15 or 
directly to the camera 11 or to the pivoting means connected 
to the latter. This is done so that the viewing angle of the 
camera 11 is thus always pre adjusted or drawn towards the 
most relevant obstacle. 

Since, in the case of obstacles having only a low structure, 
the autofocus function is slowed down or fails completely, 
the system can alternatively also include an additional 
ultrasonic or infrared light measuring system, which perma- 
nently monitors the space behind or in front of the vehicle. 

Such a system, as a component of the device, can in this 
case be operated both redundantly and also as a system 
cooperating with the camera 11 and the viewing and moni- 
toring device 15, which achieves for the viewing and moni- 
toring device is an analogous function of the selection of 
^ obstacles for the pre-positioning of the camera 11. 

For the purpose of optimization of the focal length of the 
camera lens, it has proved to be expedient to provide a 
pivoting and tilting angle for the camera 11 of up to about 
30"* from tiie neutral position. At such a pivoting angle, the 
camera 11 or its lens can still be accommodated mostly 
within the contour oi the vehicle 10, so that good protection 
can be realized without greater expenditure. 

What is claimed is: 

1. A system for monitoring a space in front of or in a rear 
of a motor vehicle which is being parked, the system 
cono^rising: 

a video camera built into either the front or rear of tiie 
vehicle; 

55 a viewing and monit<xing device, having a display screen, 
operatively coupled to said video camera, said viewing 
and monitoring device being located so as to be in a 
field of view of a driver of said vehicle; 
means for pivoting said video camera as a fimction of 

60 electric drive signals, said video camera having object- 
referenced image sharpness control of its optics, said 
sharpness control being effective over a whole image 
angle detected by said video camera such that a corre- 
sponding sharpness measuring-field is able to follow an 

65 object over the entire display screen once it is detected; 
an image processing unit which subdivides an image 
picked up by said video camera into at least one of 
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fields, .uad^nu. and an edge re^ooa^^c^^ ^^^^^Zt^'^Z^^.Z^^ 

and a central region ananged made an aiKfliiffy&ame P""**'."^ insodoiM a near obstacle more 

S:^ncrto1aidatleaston7of*efidds.qu^antsand least one of addMon^^oun^b^^d^^^^ 

edee and central r«ions of the auxiliary frame; means and sensors cooperating ^» 

«.?L;pnK^rv„^Senerating saidele^cc^^ '^rS^sJ^LS^toS^wS said addition^ 

signals for said pivoting means to ^^^^^^^ ^luJ^^^Sleastto said viewing and monitoring 

camera sud. that the sharpness ^^^^^^^^^ S^aSfsidc, and in that detection results of said 

one of does l«^^ S.^ means can be displayed on the displaying s<xeen 

reaches a predetermined field or P««"«T^^^ monitoring device, 

quadrants, and does not cross from tte^r^on ^fl^^^'^^f^todato 6. wherein said additional 

ovex the auxiliary frame into the edge ^on of^^ ^^^^SX connected to said image processing 

imagp field, so as to one of count««, neutralize and ^^j^^j^g being designed such that it 

eliX.teasamplingpivotingofthevideocamerafrom ^^^^^^ Jevant^^ via its relative 

being triggered. nosition in the image field of a detection space of the 

i A system acconling to daml, f «^ « iBcans. and can transmit the data, at least for a 

referenced image sharpness control is earned out using aa«^ preadjustment of the video camera for the purpose 

fuzzy logic. immediate centering of its sharpness measuring field, to 

ni--Jm"^?;Sr^ercompris.glas. 
i;SS:si;n'^^-^tS,?tir^^^ « sci^^Iu^sf^UarcspeCve nearest c*su.e 

JS^J^votinTof ,hecamerais.riggered,Mlj^^^^ usmg ^-^^ „ ,,3^ ,aid laser 

a pivoting angle 5 of video order to detea a JOA s^ ^J^^ ^ ^ dewing and 

most con^lete field of view (P) possible . . . monitoAie device on the driver's side, and in that detecuon 

4. A system according to claun 3, "h""" said^ge ^^^Sf^^'f^ sean likewise be displayed 

processing unit is further designed such that, dumg a '^^'^^^^^^^J^^cmos^ij^^^giStvic^ 

^ence of foUowing a sharpness-dominant near obstacle °°2'' JS^S to claii 1, further comprising 

saSl image P---^ ^^^^J^^^^S f^Sow^g^c ^stance of the vdude from ^ 

cycUcal scan sequence at high speed, for detecting newiy ^^^^ ^ be measured and co-indicated 

occurring obstacles. roimmsimi 35 on the display screen during a continuous detection and 

lnmMIJUt>ri^V''^'';^J^'S^^ "«^^ ,,,^,„diam 11, .told. 

marlQErinsteadcrfthelastimagcdisplayedaiidstaredbefOTe » » * ♦ ♦ 
the scan sequence, and in that an immediate insertion of a 
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[57] ABSTRACT 

A survollance system having at least one pnmary video 
camera for translating real images of a zone into electronic 
video signals al a first level of resoluUon. The system 
includes means fxx san^jling movements of an individual or 
individuals located within the zone from the video signal 
output from at least one video camera. Video signals of 
sanq7led movements of the individual is electronically com- 
pared with known characteristics of movements which arc 
indicative of individuals having a criminal intent. The level 
of criminal intent of the individual or individuals is then 
determined and an appropriate alarm signal is jnoduced. 

4 Claims, 5 Dra^diig Sheets 
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ABNORMALITY DETECTION AND 
SURVEILLANCE SYSTEM 

FIELD OF THE INVENTION 

This inveiitiCHi generally rdates to surveillaooe systems, 
and more paitioilarly, to trainable surveillance systems 
which detect and respond to specific abnonnal video and 
audio input signals. 

BACKGROUND OF THE INVENTION 

Today's surveillance systems vary in conqilexity, effi- 
ciency and accuracy. Earlier surveillance systems use sev- 
eral closed circuit cameras, cad) connected to a devc^ed 
monitGr. This type of system works suffidendy well for 
low-coverage sites, ie., areas requiring up to pcfhaps six 
camoas. In such a system, a sin^e person could scan the six 
monitors, in ^Yeal** time, and effectively monitor die entire 
(albeit small) {Totected area, offering a relatively high levd 
of readiness to respond to an abnonnal act or situation 
observed within the protected area. In this sin^est of 
surveillance systems, it is left to the discretion of security 
personnel to determine, first if there is any abnormal event 
in ]»ogres5 within the protected area, second, the level of 
concern placed on that particular event, and third, what 
actions should be taken in response to the particular cv&it 
The reliability of the entire system depends on the alertness 
and efficiency of the woiker observing the monitors. 

Many surveillanoe systems, however, require the use of a 
greater number of cameras (e.g.. more than six) to police a 
.iarger area, such as at least every roomlocated widiin a large 
museum. To adequately ensure reliable and complete stur- 
veillanoe within die |»otected area, either more personnel 
must be employed to constantly watch the addidonally 
required noonitors (one per camm), or fewer monitors may 
be used on a simple rotation schedide wherein one monitor 
sequentially displays the ouQxit images of several cameras, 
displaying the images of each camera for perti^ a few 
seconds. In anoth^ prior art surveillance system (refored to 
as the 'X2UAD** system), four cameras are connected to a 
single monitor whose screen continuously and simulta- 
neously displays the four difTerent images. In a "quaded 
quad" prior ait surveillance system, sixteen cameras arc 
linked to a single monitor whose screen now displays, 
continuously and simultaneously all sixteen different 
images. These improvements flow fewer personnel to 
adequately supernse the monitors to cover the larger pro- 
tected area. 

These inqprovetnents, however, still require the constant 
attention of at least one person. The above described 
multiple-iziiage/single screen systems suffered from poor 
resolution and conq>lex viewing. The reliability of the entire 
system is still dependent on die alenness and efficiency of 
the security personnel watching the monitors. Hie personnel 
watching the monitors arc still burdened with identifying an 
abnormal act or condition shown on one of the monitors, 
determining which camera, and which corresponding zone 
of die protected area is recording the abnormal event 
detennirung the level of concern placed on the particular 
event, and finally, d^ermining the appit^sriate actions that 
must be taken to respond to the particular event 

Eventually, it was recognized that human personnel could 
not reliably monitor the **real-time** images from one oc 
several cameras for long **watch** periods of time. It is 
natural for any person to become bored while performing a 
monotonous task, such as staring at one or several monitors 
continuously, waiting for something imusual or abnormal to 
occur, something whic^ may never occur. 
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As discussed above, it is the human link which lowers the 
overall reliability of die entire surveillance system. U.S. Fat 
No. 4.737 issued to Araki et al discloses an inqroved 
abnormality surveiliance system wherein motion sensors are 

5 positioned within a protected area to first determine die 
ivesence of an object of interest, such as an intruder. In the 
system disclosed by VS. Pat No. 4,737.847, zones having 
prescribed **waming levels** are defined widiin die protected 
area. Depending on which of diese zones an object or person 

10 is detected in. moves to. and the lengdi of time the d^ected 
object or person remains in a partioilar zone determines 
whether the object or person entering the zone should be 
considered an abnormal event or a threat 
The surveillance system disclosed in U.S. Pat No. 4,737, 

IS 847 does remove some of the monitoring responsibility 
otherwise placed on htiman persoimel; however, such a 
system can only determine an intruder's **intent** by his 
p-esence relative to particular zones. The actual movements 
and sounds of the intruder are not measured or observed. A 

20 skilled criminal could easily determine die warning levels of 
obvious zones within a protected area and act accordingly; 
spending littie time in zones haviiig a high warning level, for 
exanqile. 

it is therefore an object of the present invention to provide 
^ a survdllanoe system which overcomes the problems of the 
prior art 

It is another object of die invention to provide such a 
surveillanoe system wherein a potentially abnormal evem is 
determined by a conqmter prior to summoidng a human 
^ supervisor. 

It is anodio* ofcject of die invention to provide a surveil- 
lance system vi^iich compares sped&c measured movements 
of a particular person or persons with a trainable, predeter- 

3^ mined set of **typical* movements to d^ermine die level and 
type of a aiminai or mischievous event 

It is anodier object d this invention to provide a surveil- 
lance system which transmits the data from various sens<xs 
to a location where it can be recorded for evidentiary 

40 purposes, is another object of diis invention to provide 
such a surveillance system whidi is operational day and 
lugbt 

It is anodier object of dus invention to provide a surveil- 
lance system which can cull out real-time events which 

45 indicate criminal intent using a wciqx>n. by resolving the low 
temperanure of the weapon relative to the higher Ixxly 
temperature and by recogiuzing the stances taken by the 
person with the weapon. 
It is yet another object oi this invention to provide a 

50 surveillance system which eliminates or reduces die number 
of TV monitors aixl guards prescnUy required to identify 
abnormal events, as this system wUl perform this function in 
near real time. 

INCORPORATED BY REFERENCE 

The content of the following references is hereby incor- 
porated by reference. 

1. Motz L. and L. Bergstein ^*Zoom Leas Systems**, 
Journal of Opikai Society of America. 3 papers in VoL 52, 

60 1992. 

2. D. G. Aviv. **Sensor Software Assessment of Advanced 
Eartii Resources Satellite Systems". ARC Inc. Report 
#7O-80-A, pp. 2-107 dirough 2-119; NASA contract NAS- 
1-16366. 

65 3. Shio, A. and J. Sklansky "^Segmentation of People in 
Motion"*, Proc. of IEEE Workshop on Visual Motion, 
Princeton, NJ., October 1991. 
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4. AgaiwaL R. and J SMansI^ "Estuoati^g .OpticaL Flow FIG. 3A illustrates a frame of a video caiiicra*s ou^t 
from Qustcred TYajeaory Velocity Time"*. according to the invcntioiL, showing a *two on one** inter- 

5. Suzuki, S. and J Sklansky "Extracting Koo-Rigid action of objects (people) A. B, and C; 

Moving Objects try Tenqxxal Et^cs**, IEEE. 1992, Ttans- FHj. IB iliuslrates a later frame of the video camoa's 
actions of Pattern Recognition. ^ ou^ut of FIG. 5A. acooiding to the invention, showing 

6. Rabincr, L. and Biing-Hwang Juang "TUndamental of objects A and C moving towards object B; 

Speech Recognition**. Pub. Prentice Hall, 1993, FIG. 3C illustrates a later frame of the video camaa*s 

(p.434-49S). ou^ut d FIG. 3B, acccsding to the invention, showing 

7. Weibd. A. and Kai-Fu Lee Eds. Pleadings in Speedi objerts A and C moving in dose proximity to object B; 
Recognition**. Pub. Morgan Ki*«"fman i9go (p767-296). FKj. 3D illustiates a later franoe of the video can^ra's 

8. Rabiner L. "AppUcation of Voice Processing to ^ acoarding to the invention, showing 
Telecommunication'*. Proc. TKRP Vol 82, No. 2, Febiuary. obj«*s A and C quiddy moving away from object B; 
1994. FIG. 4 is a schonatic block diagram of a coDventional 

w<H'd recognition system which may be employed in the 
SUMMARY OF THE INVENTION invention. 

A preferred embodiment of the herein disdosed invention DEIAILED DESOUFTION OF THE 
involves a surveillanoe system having at least one primary PREFBU(ED EMBODIM0n*S 
video camera far transhiting pad imag« of a zone into Referring to HG. 1, the picture input means 10, may be 
dcctronic video signals at a first levd of rcsdution and » conventional dectrooic picture pidoip device opera- 
means for samiding movements wilMn the zwie from die ^^^^^^ „ a)cctrum (or b^) 
video camoa output TTiese elements arc combined with -^^^ ^ ^ cCDav camera of moderate 
means far dectromcallyconqwnng the saiiq>led movements jcsohition, e.g. a camera about M indies in lengdi and 
withtoo«mchar«^ about lindi in diameter, wdghing about 3 ounces, inchiding 
tive of mdividuab engaged m<^^ 25 particular deployment a zoom lens attaduncnt This 
for detcnmnhig the levd of sudi crumnal activity. Assod- intended to operate continuously and translate die 
ated tiiercwith are means for activating at least one second. ^^^^ ^.^.y ^^^^^ ^ ^ obsavalion area 
ary sensor and assooated reooidiiig device having a second ^^^^ conventional video dcciraiic signals, 
higher levd of resolution, smd^ in Altanativdy, a high rate cam«Aeccrder, up to 300 
i^nsetodetenmmngapnsdetermmedlevdofai^ 30 fra„^3^see (siMar to&ose made 1^ NAC Vi^^^ 

of Woodland Hills, Calif., SONY and others) may be used as 

BRIEF DESCRIPnON OF THE DRAWINGS *® picture input means This would enable the detection 

of even the very rapid movement of body parts that are 

FIG. 1 is a sdiematic block diagram of the video, analysis. indicative of criminal intent, and their recording, as herdn- 

oontrol. alarm and reccarding subsystems of an onbodiment below described. The incHe ccsnmonly used camera operates 

cf diis invention; at 30 frames per second and cannot ci^>ture such quick body 

FIG. 2A illustrates a frame K of a video camera's ou^mA movement with sufi&dent resdution. 

€i a particular environment, according to the invention. Picture input means 10, instead of operating continuously, 

showing four representative objects (people) A, B, C and D, may be activated by an ^'alcrtf* signal from the processor of 

wherein objects A. B and D are nooving in a direction the low resolution camera or from the audio/word rtcogni- 

indicated with arrows, and object C is not moving; tion processor when sensing a suspdous event. 

FIG. 2B illustrates a frame K+5 of the video camaa*s Picture iiqmt means 10 contains a preprocessor which 

output according to the invention, showing objects A, B. normalizes a wide range cf illumination levds, especially 

and D are stationary, and object C is moving; 45 for outside observation. The prqpnx^esscr emulates a veite- 

FIG. 2C illustrates a frame K+10 of the video camera's bratc'srctina, which has a an eflfidcnt andacairatc nonnal- 

ou^ut, according to the invention, showing the current ization process. One such preprocessor (VLSI retina drip) is 

location of object A, B, C, D, and E; fabricated by tiie Carver Meade Labwatory of die CaUfcraia 

FIG- 2D iUustrates a frame K+11 of the video camera's Tcdmology in Pasadena, Calif^ Use of tius 

output according to die invention, showmg object B next to «> Particular I«^«>c^s«^ ctaP wOi moease the automated 

n «>»H u tr. A» vision capatulity of this invention whenever variation of 

object C, and object E moving to Oie rigjit; :„t^3^ a*. 

TTwr^ -11 ^* -J ♦ light intensity aud ugjitrcflection nwy othcTwisc weakcu the 

FIG. 2E lUustiates a frame K+12 of tiie video camera's ^oturc lesolmion.^^ 

output according to die invention, showing a potential crime • 1 < - ^ ^ ^ 

taldng place between objects B and C; . Ttesignak from die p^ 

wrr-^ f. Mr to . 55 wto digitized signals aud tfaeo scut to thc plcturc pcocessing 

FIG. 2F Illustrates a frame K+13 of die video camera's ^ piocessOT means controlling each groupTrf 

output according to Uic invention, showmgolqectsB and C ^ governed by an aitifidal inteUigence 

intcrarlmg; system, based on dynamic pattern recognition principles, as 

FIG. 2G illustrates a fran^ K+15 of the video camera's further described below. Picture processing means U 

ou^ut according to die invention, showing object Cmovmg ^ indudes an image rastex analyzer which effectivdy seg- 

tiie rigjit and object B following; nients each hnage to isohdc cadi pair of people. The image 

FIG. 2H illustrates a frame K+16 of the video camera's raster analyzer subsystem of picture processing means 12 

ou^ut, according to the invention, showing object C moving segments each sanqded image to identify and isolate each 

away from a stationary object B; pan* of objects (or peqie), and each 'two on one** group of 

FIG. 21 illustrates a frame K+17 of die video camera's 65 three people separatdy. 

output acocHding to the invention, showing object B moving The 'two on one" grouping represents a common mug- 

towards object C; ging situation in which two individuals approach a victinu 
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one firom in front of the victim and the other from behind. 
The frHward vasigga tells the potential victim that if he does 
not give 19) his money* (cr watch, ring, etc) the second 
mugger will shoot him, stab or otherwise hann hioL The 
group of three people will thus be considered a potential 
crime in progress and will thoefore be segmmted and 
analyzed in picture processing means. 

With respect to a zoom lens system osefiil as an clement 
in the picture iiq>ut nsans 10, the essoitiais the zoom lens 
subsystem are described in tbtoc papers written by L. Motz 
and L. Beigsteio. id an artide titled **Zoom Lens Systems" 
in the Journal of Optical Society of America, Vol. 52, ApriL 
1992. This article is hereby incoiparated by reference. 

The essence of the zoom system is to vary the foetal length 
such that an object being observed will be focused and 
magnified at its image plane. In an automatic version of the 
zoom system, once an object is in the camera' s freld-of-view 
(FOV), the lens moves to focus the obgcct onto the camera's 
image plane. An eiror signal winch is used to ccHiect the 
focus by the image planes is generated fay a CCD array into 
two halves and measuring the difference, segmenting in each 
until the object is at the center. Dividing the CCD aiiay into 
more than two segments, say four quadrants, is a way to 
achieve automatic centering, as is the case with mono-pulse 
radar. Regardless of die number of segments, the error signal 
is used to generate the desired tracking of the object. 

In a wide field-<^-view (WFOV) c^)eration, there may be 
more than one object, thus special attention is given to the 
design of the zoom syston and its associated software and 
firmware control Assuming three objects, as is the **two on 
one" potential mugging threat described above, and ttiat the 
three persons are all in one plane, one can jsogram a shifting 
from one object to the next, from one face to aix>thcr face, 
in a prescribed sequential rader. Moreover, as the objects 
move within the WPOV they will be automatically tracked 
in azimuth and elevation. In principle, the zoom wotUd focus 
on the nearest object, assuming that the mount of light on 
each object is the same so that the prescribed sequence 
starting from the closes object will proceed to the remaining 
objects from, for example, right to left. 

However, when the three objects are located in different 
{danes, but still within the camera's WFOV, the zoom, with 
input from the segmentation subsystem of the picture analy- 
sis means 12 will focus on the object closest to the right hand 
side of the image plane, and then proceed to move the focus 
to the left, focusing on the next object and on the next 
sequentially. 

In all of the above cases, the automatic zoom can more 
naturally choose to home*in on the person with the brightest 
emission or reflection, and then proceed to the next bright- 
ness and so forth. This would be a form of an intensity/time 
selection multq>lex zoom system. 

The relative positioning of the input camera with respect 
to (he area under surveillance will effect the accuracy by 
whidi the image raster analyzer segments each image. In 
this preferred embodiment, it is beneficial fot the input 
camera to view the area under surveillance from a pcuit 
located directly above, e.g., with the input camera mounted 
high on a wall, a utility tower, 03^ a traffic light support towet 
The height of the input camera is prefeiaUy sufficient to 
minimize occlusion b^een the iiq>ut camera and ttic move- 
ment of the individuals under surveillance. 

Once the objects within eadi sampled video frame arc 
segmented (i.e., detected and isolated), an analysis is made 
of the detailed movements <^ eadi object located within 
each particular segment of each image, and their relative 
movements with respect to the other objects. 
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Eadi image frame segment, once digitized, is stored in a 
frame by frame memoiy storage of picture processing means 
12. Each frame from the picture input means 10 is subtracted 
from a previous fi^ame already stored in processing means 12 

5 using any conventional differencing process. The differenc- 
ing process involving mult^le differencing steps takes i^ace 
in the processing section 12. The resulting difference signal 
(ou^pimed hom the differencing sub-section of means 12) of 
each image indicates afi the changes that have occuned £Dom 

10 one frame to the next These changes include any move- 
ments of the individuals located within the segment and any 
movements of their Mmbs, e.g.. arms. 

Ref cning to FIG. 3. a collection <^ differencing signals for 
each moved object of subsequent sanQ)led frames of images 
15 (called a **lrack**) allows a determination of the type, speed 
and direction (vector) of each motion involved, processing 
which will extract acceleration. Le.. note of change of 
velocity: and change in acceleration with respect to time 
(called *'jeikiness'*), and ocnrelating this with stored signa- 
ge hires of known physicai criminal acts. Fot example, subse- 
quent differencing signals may reveal that an individual's 
arm is moving to a high position, such as the upper limit of 
that arm's motion, Le.. above his head) at a fast speed. This 
particidar movement could be perceived, as described 
^ below, as a hostile movement with a possible criminal 
activity requiring the expert analysis of security personnel 
The intersection of two tracks indicates the intersection of 
two moved objects. The intersecting objects, in this case, 
could be merely the two hands of two people greeting each 
^ other, or dqiending on other characteristics, as described 
bdow, the intersecting objects could be interpreted as a fist 
of an assailant contacting the face of a victim in a less 
friendly greeting. In any event, the intersection of two tracks 
immediately requires further analysis and/or the summoning 
of security personnel But the generation of an alarm, fight 
and sound devices located, for example, on a monitor will 
turn a guard's attention only to that monitor, hence the labor 
savings. In general however, friendly interactions between 
individuals is a much slower physical process than is a 
^ physical assault vis-a-vis body parts of the individuals 
involved. Hence, friendly interactions may be easily distin- 
guished from hostile physical acts using current low pass 
and high pass filters, and current pattern recognition tech- 
niques based on e:qiainaental reference data. 

When a large number of sensors (called a sensor suite) are 
distributed over a large number of facilities, for exarople. a 
number of ATMs (autonuitic teller machines), associated 
with particular tiank branches and in a particular state or 
^ states and all q)erated under a single bank network control 
then oidy one monitor is required. 

A oxnmercially available software tool may enhance 
object-movement analysis between frames (called (^cal 
flow conq>utation). Widi optical flow conq>utation, specific 

ss (usually bright) reflective elements, called farkles, emitted 
from the clothing and/or the body parts of an individual of 
one frame arc subtracted from a previous frame. The tiright 
portk>ns will inherently provide shaipa detail and therefore 
will yield mm accurate data regarding die velocities of the 

60 relative moving objects. Addidonal computation, as 
described below, will provide data regardirig the acoel^a- 
tion and even change in aoceleratioD or "jeiidness'' of each 
moving part sampled. 
The physical motioi^ of the individuals involved in an 

65 interaction, will be detected by fixst determining the edges of 
the of each pcnon imaged. And the rrK)vements of the body 
parts will then be observed by noting the movements of the 
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edges of the body paits of the iadividuals involved in the ooay vary. For auaxspLc. in a high risk area, every frame firom 

intexacdon. The diffoencing process will enable the deter- the CCDAV camera may be analyzed continuously to 

mination of the velocity and aocderation and rate of acoel- ensure that the maximum amount of informatioD is recorded 

cration of those body parts. prior to and dunng a crime. In a low risk area, it may be 

The now processed signal is sent to comparison means 14 5 preferred to sanq>le potiaps evoy 10 frames from each 

which conges selected flames of the video signals from camera, sequentially. 

the picture input means 10 with **signature** video signals If, during such a sanqding, it is detomioed that an 

stored in memory 16. The signature signals are r^esenta- abnormal or susjAcious event is occurring, such as two 

tive of various positions and movements of the body ^osts of pe<^le moving veiy close to each other, then the system 

an individual having various levels of criminal intent The would activate an alert mode wherein the system becomes 

m^hod for obtaining the data base off these signature video ""concerned and curious** in the suspicious acdons and the 

signals in accordance with another aspect of the invention is sanqiling rate is increased to perhaps every 5 frames or even 

descrit)ed in greater detail below. every frame. As desciibed in greater d^ail below, depending 

If a conqwison is made positive with one or more of the on the type of system enq>loyed (Le., video only, audio only 

signature video signals, an output "alert" signal is sent from or both), during such an alrat mode, the entire system may 

the comparison means 14 to a orailroller 18. The conttoUer he activated wherein both audio and video system begin to 

18 controls the operation of a secondary, high resolution sample the environment for sufficient infonnation to deter- 

picture input means (video camera) 20 and a conventional ""^c intent of the actions. 

monitor 22 and video recorder 24. Hie field of view of the Refening to FIG. 2, several frames of a particular camera 

secondary camera 20 is preferably at most, the same as the ^ output are shown to illustrate the segmentation process 

field of view of the primary camera 1#, surveying a second performed in accordance with the invention The system 

observationarea.Therec(mier 24may bek>catedatthesite begins to samfit at frame K and d^ermines that th^ are 

and/or at both a law enforcemoit facility (not shown) and four objects (previously determined to be people, as 

simultaneously at a court ofiEice or legal facility to prevent described below)» A-D located within a particular zoite being 

loss of incriminating information due to tanq)ering. ^ policed. Since ncMhing unusual is determined from the initial 

The purpose of the secondary canoera 20 is to provide a analysis, the system does not warrant an "alert" status, 

detailed video signal of the individual having assumed People A, B, and D aie moving accccding to normaL 

criminal intent and also to in^ffove false posifive and false non-criminal intent, as could be obsCTved. 

negative performance. This information is recorded by the A crime likelihood is indicated vfhen frames K+IO 

video recorder M and displayed on a monitor 22. An alarm ^ through K+13 are analyzed by the differencing process. And 

bell or light (not shown) or both may be provided and if the movement of the body parts indicate velod^, accel- 

activated by an <Hi^t signal from the controller 20 to erarion and "jexkiness** that con^>are positively with the 

summon a supervisor to immediately view the pertinent stored digital signals depicting movements of known crimi- 

video images showing the apparent crime in progress and nal physical assaults, it is likely that a crime is in progress 

access its accuracy. here. 

In still another embodiment of the invention, a VCR 26 is Additioiudly, if a high velocity of departure is indicated 

operating continuously (using a 6 hour loc^tape, for when person C moves away from person B, as indicated in 

exan^le). The VCR 26 is being controlled by the VCR frames K+15 dnough K+17, a iarger level of confidence, is 

controller 28. All the **real-time" images directly from the ^ attained in deciding that a physical criminal act has taken 

picture iiq>ut means 10 are immediately recorded and stored place or is about to. 

for at least 6 hours, for example. Should it be determined An alarm is generated the instant any of the above 

that a crime is in progress, a signal from the controller 18 is conditions is established. This alarm condition will result in 

sent to the VCR controller 28 chai^g the mode of record- sending in Police or (juards to the crime site, activating the 

ing from tape looping mode to non-looping mode. Once the ^ ^ high resolution CCD/FV camera to record the face of die 

VCR 26 is diaiigcd to a non-looping nKyde^ (he tq>c will not person committing the assault, a loud speaker being acti- 

re-loop and will therefore retain the pohaps vital recorded vated automatically, playing a receded announcement 

video information of the surveyed site, induding tiie crime wamiiig the perpetrator the seriousness of his actions now 

itself^ and the events leading up to the crime. toeing undertaken and demanding that he cease the criminal 

When the non-looping mode is initiated, the video signal 50 act After dark a strong light will be turned on automatically, 

may also be transmitted to a VCR located elsewhere; for The automated refuses wiU be actuated the instant an 

exaiiq>le, at a law enforcement facility and, sinuiltaneously alarm condition is determined by the processor, 

to otha secure locations of the Court and its assodated Fixrthermore, an alarm signal is sent to the pc^ce station, and 

offices. the same video signal of the event is transmitted to a court 

Prior to the video signals being compared with the "sig- 55 appointed d^ collection office, to the PubUc Defender's 
nature" signals stored in memory, eadi sanded frame of ofSce and the District Attorney's OfiBce. 
video is "segmented" into parts relating to the objects As described above, it is necessary to compare the result- 
detected therein. To segment a video signal, the video signal ing signature of pl^sical body parts motion involved in a 
derived from the vidicon or CCD/TV camera is analyzed by physical criminal act, that is expressed by ^>ecific motion 
an image raster analyzer. Although this process causes slight 60 characteristics (i.e., velocity, acceleration, change of 
signal delays, it is accomplished nearly in real time. acoel^tion), widi a set of signature files of physical crimi- 

At certain sites, or in certain situations, a high resolution nal acts, in which body parts motion arc equally involved, 

camera may not be required or otherwise used. For cxanq}tc. This comparison, is coimckoidy referred to as pattern match- 

the resolution provided by a relatively single and low cost ing and is part oi the pattern recognition process, 

camera may be sufficient Dq>ending on the level of security 65 Files of physical criminal acts, which involve body parts 

for the particular location being surveyed, and the time of movements such as hands, arms, elbows, shoulder, head, 

day, the length of frame intervals between analyzed frames torso, l^s, and fe^, can be reviewed to ascertain this 
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pattern. In addition, a priority can be set by e3q)cd2nents and 
simulations ctf physical criminal acts gatheml from ^dra- 
mas" that are enacted by professional actors, the data 
gathered from «q)crienced muggers who have been caught 
by the police as wdl as victims who have reported details of 5 
their experiences win help the actors peifonn accurately. 
Video of their motions involved in these simulated acts can 
be stored in digitized form and files prepared fcH" signature 
motion of eadi of the t>ody parts involved, in the simulated 
pfaydcal adminal acts. 

In another embodiment the above described Abnormality 
Detection System includes an RF-ID (Radio frequency 
Identification) tag or card to assist in the detection and 
tracking of individuals within the field of view of a camera. 
Such cards or tags could be used by authorized individuals 
to respond when queried by the RF intenogator. The 
re^nse signal of the tags propagation pattern which is 
adequately registered with the video sensor. The card or tag, 
when sensed in video, would be assumed fiiendiy and 
authorized. This infomiatioo would simplify the segmenta- 
tion process. ^ 

Alight connected to each RF-ID card wiU be turned ON, 
when a positive response to an interrogation signal is 
established. The light will appear on the compota generated 
grid (also on the screen <^ the monitor) and the intersection 
of tracks cleariy indicated, followed by their physical inter- 
action. But also noted will be the intersection between the 
tagged and ttie untagged individuals. In all of such cases, the 
segmentation process will be simpler. 

There are many manufacturers of RF-ID cards and ^ 
Interrogators, ttuee major ones are. The David Samoff 
Research Center of Princeton, N J., AMTECH of Dallas, 
Tex. and MICRON Technology of Boise, Id. 

The £q)i^cations of the presmt invention include banks, 
ATMs, hotels, schools, residence halls and dormitoffies, 3^ 
ofBcc and residential bufldings, hospitals, sidewalks, street 
aosstngs, parks, containers and container loading areas, 
shqyping piers, train stations, truck loading stJitions, aicpcMt 
passenger and freight facilities, bus stations, subway 
stations, theaters, concert halls, spent arenas, iitoaries, ^ 
churches, museums, stores, sho(^sing malls, restaurants, 
convenience s^s, bars, coffee sh<^ gasoline stations, 
highway rest stops, tuimels, bridges, gateways, sections cf 
highways, toll booths, warehouses, and depots, factories and 
assembly rooms, law enforcement facilities inciudiiig jails. ^ ^ 
Any location or facility, civilian or militaiy, requiring secu- 
rity would be a likely qiplication. 

Farther applications of this invention are in moving 
platfcfms: automobiles, trucks, buses, subway cars, train 
cars, both freight and passenger, boats, sYups (passenger and 50 
freight), tankers, service and construction vdiidcs, on and 
(^-road, contains and their carriers, and airplanes, and 
also in equivalent military and sensitive mobile platforms. 

As a detenence to car-jacking a tiny CCD/TV camera 
hidden in the ceiling or Ihc rearview mirror ol the car, and 55 
focussed through a pin hole lens to the driver's seat, may be 
connected to the video processor to locord the face of the 
drive. The camera is triggo^ l>y die automatic word 
reoognidon jnrocessor that will identify the well known 
expressions commonly used by the car-jacka. The video 60 
pcture will be recorded and then transmitted via cellular 
phone in the car. U^out a phone, the short video recording 
of the face of the car-jacker will be held until the car is found 
by the police, but now with the evidence (the picture of the 
car-jacker) in hand. 65 

Id this present surveillance system, the security personnel 
manning the monitors are alerted only to video images 
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^iiich show su^dous actions (oiminal acrivities) within a 
prescribed observation zone. The security personnel are 
therefore used to access the accuracy of the crime and 
determine the necessary actions for an ap p r o pri ate respcmse. 
By using computers to effectively filter out all normal and 
noncriminal video signals from observation areas, fewer 
security personnel arc required to survey and "secure** a 
greater overall area (including a greater number of obser- 
vation areas. Le., cameras). 

It is also contenq)lated that the present system could be 
appUed to assist blind people "see**. A battery operated 
portable version of the video system would automatically 
identify known objects in its field d view and a speech 
synthesizer would "say" the ob|ect For exan:q)le, "chair**, 
"table**, etc would indicate the presence of a chair and a 
table. 

Depending on the area to be policed, it is preferable that 
at least two and pediaps three canvas (or video sensors) are 
used simultaneously to cover the area. Should one camera 
sense a first levd of criminal action, the other two could be 
mantptilated to provide a three dimensional perspective 
coverage of the action. The three dimensional image of a 
physical interaction in die policed area would allow obser- 
vation of a greats number of d^ails associated with the 
steps: accost, threat assault, response and post response. 
The conversion process from the two dimensional image to 
die three dimensional image is achieved by use of die known 
Radon transform. 

In the extended operation fdiase the invention as more 
details of the physical variation of movement characteristics 
of physical threats and assaults against a victim and also the 
speaker independent (male, female of different ages groups) 
and dialect independent wcwds and terse sentences, with 
corresponding responses, will aiMt automatic recognition 
of a criminal assault, without be need of guard, unless 
reqiured by statutes and other external requirements. 

In another embodiment of the present invention, both 
video and acoustic information is saixq>led and analyzed. 
The acoustic infarmati<w is sampled and analyzed in a 
similar manner to the sampling and analyzing of the above- 
described video information. The audio information is 
sanqiled and analyzed in a manner shown in FIG. 4, and is 
based on prior art 

The employment of the audio speech band, with its 
associated Automatic Speedi Recognition (ASR) system, 
will not only reduce the false alarm rate resulting from the 
video analysis, but can also be nsed to trigger the video and 
other sensors if the sound threat predates the observed threat 

Refening to FIG. 4, a conventional automatic word 
recognition system is shown, including an input microphone 
system 40, an analysis subsystem 42, a template subsystem 
44, a pattern oonq>arator 46, and a post-processor and 
decision logic subsystem 48. 

In operation, iqwn activation, the acoustic/audio policing 
system will begin saiiq>ling all (cv a selected portion) of 
ncartiy acoustic signals. The acoustic signals will indude 
voices and background noise. The background noise signals 
are generally known and predictable, and may therefore be 
easily filtered out using conventional filtering techniques. 
Among the expected noise signals are unfamiliar speech, 
automotive related sounds, honking, sirens, the sound of 
wind and/or rain. 

The microphone input system 40 pick-iip the acoustic 
signals and imnkediately filter out the predictable back- 
ground noise signals and ainplify the remaining recogniz- 
able acoustic signals. The filtered acoustic signals are ana- 
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lyzcd in the analysis subsystem 42 \Adsh processes the Put hdefly, the HMM qiplies probabilistic statistical 

signals by means of digital and spectral analysis techniques. is'ocediiie in leoognizing words. In the training steps, an 

Tbt output of the analysis subsystem is conq>ared in the estimate is of the rp«n<i and covarianoe of the pioba- 

pattern CCTnpaiatff suteystem 46 with selected predeter- bilistic model of each wonL e,g., those wcfds which arc 
mined w<ffds stored in memory 3 considcral likely to be nttiicd in an interaction. The various 

^ dS^ '^"^ ^"^"^^ an alarm signal ^^^^ ^ pronounced, pennits the 

""jhc templates'^ include perhaps about 100 brief and "^J^fi^f"^!" "^Zt^- ^ ^^^""^ "^"^ 

easily r^t^e terse expS^siolc^, s<Hne of which art of the model The stq« mvohred m ^mnn& "!Sl°! 

single war<b, and arc commoQly used by those intern on a "^^^ word coo^ of con^^ 

oimhial act Some examples of commonly used w<tfd the word was generated by each of the models developed 

phrases spoken by a oiminai to a victim prior to a mugging. during the training. The word is considered as 'Recognized" 

for example, include: 'Xiive mc your moneys, 'This is a when its modd gives the highest score. Finally, since the 

stick-iq)", 'XKve me your wallet and you won't get hurT . . words are conqwsed of word units, the evaluation of con- 

. etc. FuithemtDre. commonly used replies from a typical diti<nial probabilities of one particular unit followed by the 

victim during such a mugging may also be stored as tcn^late same or another word unit is also part of the con:putation. 

^^'^d "* " '^'^ ^ ^ P^'^ « considaably 

screams ana groans, nc. shorter than flic aitirc list of all spoken words of the English 

J^,^^^S^lK^fr^ ^^^^ ^ HMM^stem employed 3hc 
r^trjSi^rL^^^ 20 presenlinventionaUowsboththeaudioandvideosystemsto 

spoken in the iciJon of concent HencTa statisti«d av^^ ^^P™^ ^"i*y ™^ FotebiUty statistics to 

agingof the spectral content of each w«d most be used- P^«^ movonents or wwds based on an early 

THeoutputof thew<Hdrecognition system shown in FIG, ^S^^on of initial movements and word stems. 

4 is used as a triggo- signal to activate a sound recorder, or xbe HMM system may be equally en^loyed in the video 
a camera used elsewhere in the invention, as described 25 reoognitiott system. F6r cxanQ>le. if a person's arm quickly 

^^w. moves above his head, the HMM system may determine that 

The pfefened microphone used in the micrpphone input tttere is a tug^ probability that the «rm will quickly come 

subsystem 40 is a shot-gun microphone, such as those down, pcriiaps indicating a criminal intent 
commercially available from the Sennheisa Conmany of 

ftankfurt Germany. These miCT<^one have a super- 30 Whfle certain embodiments of the invention have been 

cardioid iHopagation pattern. However, the gain of the described for iUustrative purposes, it is to be understood ttiat 

pattOT may be too smaU for high traffic areas and may there may be various odier modifications and embodiments 

therefore require more dian one micraphone in an array widiin the scope of die invention as defined by die following 

configuration to adequately focus and track in these areas. claims. 

Ihe propagation pattern of the microphone system oiables 33 What is claimed: 

better focusing on a moving sound source (e.g., a person 1. A surveillance system, oomprisiiig: 

walking and talking). A conventional diiectioaal micro- ^ ^ ^^^^ *r«»«i.K»« i^^^^ «f 

/ . 7~ . . , _r I ^ fi) * vioeo carina tor translating real moages ot an area 

mone may also be used m place of a shot-gun type , . . . .^Ti 

™ . jiLu^e jni ^* \x into elcctromc video sunals; 

micrcqihone, such as those made by ttie Sony Corpontion of 

To^o, Japan. Such directional microphones will achieve 40 ^) means for saocqKlmg noovemeats of an individual 

similar gain to the shot-gun type miCTciAones, but widi a locatisd within die area from said electronic video 

smaUex physical structure. ^ ^<*«> 

A feedback loop circuit (not specifically shown) originat- c) means for electronically comparing said sampled 

ing in the post processing subsystem 48 wiU direct the movements with predetermined characteristics of 

mioopbone system to track a particular dynamic source of movements; 

sound within the area surveyed by video cameras. d) means for predicting future movements of said indi- 

An override signal fxoui the video portion of the present vidual tiascd on said electronic comparing means of 

invention will a^vate and direct the microphone system sidd samj^ed movements; and 

towards the direction of the field of view of the camera. In e) means for generating a signal responsive to predeter- 

other words, should the video system detect a potential ^ mined predicted future movements, 

crime in progress, die video system will control the audio 2. The surveillanoe system in aca»dance with claim 1. 

recording system towards die scene of interest Likewise, wherein said signal generating means activates a video 

should the audio system detect words of an aggressive signal rec<Hdcr for reconling said video signals from said 

nature, as described above, the audio system will direct camera. 

q>propriate video cameras to visually cov^ and record die 3. The sunreUlance system in acoardance with claim 1, 

q^parent source of the sound. wherein said signal generating means activates a micro- 

A number of companies have developed very accurate and phone for receiving audible information of said individual 

efficient, speaker independent word recognition systems located in said area. 

based on a hidden Markov modd (HMM) in oombination 4. The surveillanoe system in accordance with claim 1, 
widi an artificial neural network (ANN). These conq>anies ^ wherein said signal generating means activates at least one 

include IBM of Armonk. N.Y., AT&T Bell Labofatories, high resolution camera. 
Kurtzwell of Cambridge. Mass. and Lcmout and Hausfrie cf 

Belgiunt » * * » * 


